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ABSTRACT 

This project was designed to produce a program 
evaluation and needs assessment of the 1982 Alberta Elementary School 
Mathematics Program in terms of cognitive level comparisons between 
student responses and curricular demands. Assessment procedures 
consisted of 14 individual interviews and 8 paper-and-pencil tests 
based on children's responses to mathematical cognition tasks in 
one-one interviews. The same criteria embedded in student response 
assessments were applied to demands made by mathematics curriculum 
objectives, textbooks materials, classroom activities, and Alberta 
Education Assessment Test items. The project sampled curricular 
cognitive demands and student cognitive response levels from the sis 
elementary school grades and across five mathematics topic strands 
(numeration, operations and properties, measurement, geometry, and 
graphing). Answers to various research , ""it ions varied by topic 
stand, grade level, and demand component. However, several general 
findings are noted. About three-quarters of all student responses 
were at the concrete operational level, with remaining answers at the 
preoperational level. About three-quarters of all demands were at the 
concrete operational level, with most of the remaining quarter at the 
early formal level. In general, cognitive demands made by the 
curriculum were found to correspond well to distributions of student 
cognitive responses in most topics and at most grade levels. 
(Authoi/JN) 
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FOREWORD 

". . the so-called aptitudes of 'good' students in mathematics or 
physics, etc., consist above all in their being able to adapt to the 
type of instruction offered them, whereas students who are 'bad' in 
these fields, but successful in others, are actually able to master 
the problems they appear not to understand— on condition that they 
approach them by another route. 

"What they do not understand are the 'lessons' and not the 
subject. Thus it may be— and we have verified it in many 
cases— that a student's incapacity in a particular subject is owing 
to a too-rapid passage from the qualitative structure of the 
problems (by simple logical reasoning but without the immediate 
introduction of numerical relations and metric laws) to the 
quantitative or mathematical formulation (in the sense of previously 
worked-out equations) normally employed by the physicist . . . even 
in mathematics many failures in school are owing to this excessively 
rapid passage from the qualitative (logical) to the quantitative 
(numerical) ." 

Piaget, J. (1972). A Structural Foundation for Tomorrow's 

Education. Prospects : Quarterly Review of Education, UNESCO, 
2, Spring 1972. 
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ABSTRACT 

The Assessing Cognitive Levels in Classrooms (ACLIC) project was aesignea 
to proauce a program evaluation and nee n s assessment of the 1982 Alberta 
Elementary School Mathematics Program in terms of cognitive level comparisons 
between pupil responses ana curricular aemanas. At the heart of the ACLIC 
Project is a question that has frequently been asked in the mathematical 
education literature, past and present: Is there a reasonable fit between the 
instructional aemanas implied by a mathematics curriculum ana the response 
levels attained by the intendea students? 

In the ACLIC Project, cognitive assessment procedures were developed for 
the whole range of mathematics topics in the elementary school grades. These 
consistea of fourteen individual interviews and eight paper-ana-pencil tests 
basea on children's responses to mathematical cognition tasks in one-one 
interviews. The same criteria imbedded in the student response assessments 
were appliea to the demands made by mathematics curriculum objectives, 
textbook materials, classroom activities, and Alberta Education Achievement 
Test items. 

The project sampled curricular cognitive demands and student cognitive 
response levels from the six elementary school grades and across five 
mathematics topic strands: Numeration, Operations and Properties, Measurement, 
Geometry, and Graphing. 

Students were selected from across the province to ensure a sample that 
was provincially representative, including an appropriate urban/rural balance. 
In all, 1767 interview task assessments were made of the responses from 360 
Graae 1 to 3 students who were interviewed by 23 Teacher-Interviewers. Grade 
3 to 6 student response levels were assessed by means of eight 
paper-and-pencil tests that were completed by 1677 students. The information 
collected was used to answer the following questions: 



1) What levels of cognitive ability are demonstrated in 
mathematics topic contexts by Alberta students in each of Graaes One 
through Six (ages six through eleven)? 

2 s *hat are the levels of cognitive demand made on students at 
each graae level by: 

i) the curriculun objectives identified by the Elementary 
Mathematics Curriculum Guide, Alberta Education, 1982, 
ii) the prescribed textual resources, 
iii) teacher presentations, and 
iv) teacher-made tests? 
3) How well do the curricular demands (made by Curriculum 
Objectives, texts, teacher presentations, and tests) fit the 
distributions of student cognitive ability at each grade level in 
particular mathematics topic strands? 

The answers to the three research questions varied a great deal with 
topic strand, grace level, at.d demand component and they really should be 
considered in specific contexts. However, to provide a brief overall summary, 
general answers follow. 

1) About three-quarters of all student responses were at the Concrete 
Operational level (Early Concrete and Late Concrete levels together) . The 
remaining quarter were primarily at the Preoperational level in the early 
grades ano at the Early Formal and Formal Operational levels in the nigher 
grades. 

2) About three-quarters of all demands were at the Concrete Operational 
level (Early Concrete and Late Concrete combined). Of the remaining quarter, 
most occurred at the Early Formal level, with small percentages at the 
Preoperational and Formal Operational levels. The distributions of Curriculum 
Objective demands showed the greatest consistency across strands and the most 
consistent pattern of increasing demands as the grade level increased. The 
pattern of the demands of the Textbooks was found to be very similar to that 
of the Curriculum Objectives. The Classroom lessons observed made 
predominantly Concrete Operational (Early Concrete and Late Concrete combined) 
demands in the lower grades and predominantly Formal Operational (Early Formal 
and Formal combined) demands in the higher grades. The cognitive demands of 
the Achievement Test items were mainly u^crete Operational (Early Concrete 



ana Late Concrete combined) in Grade 3 and mainly Early Formal Operational in 
Grade 6. There were no Preoperational demands, and in only one instance were 
there Formal Operational demanas, that being at Grade 6 in Operations. 

3) In general, the cognitive demands made by the curriculum and its 
interpretations have been found to correspond reasonably well to the 
distributions of stuaent cognitive responses in most topics and at most grade 
levels. In most areas there were some matches, some demand distributions 
significantly lower, and some aemand distributions significantly higher than 
the corresponding student response distributions. The best overall fit 
between demand distributions and the student response distribution occurred at 
the Grade 4 level where 64% of the demand and response distributions matched. 
However, there were also some striking mismatches. For example, at Grade 5 in 
three of the four strands all of the demand distributions were significantly 
higher than the corresponding response distributions. In Grade 1 less than 
one-tenth of the demand distributions matched the corresponding response 
distributions. The one topic strand in which the demand/response pattern was 
particularly noteworthy was Measurement — all of the Measurement demand 
distributions were significantly higher than the pupil response distributions 
at every grade level. 



ERLC ° 



ERLC 



ACKNOWLEDGEMENTS 

We wish acknowledge and thank the many persons who have contributed to 
this stUG/. Zr particular, we wish to express our sincere appreciation to the 
following: 

Dr. K. Lovell for the excellent summary of Piaget's theory tiiat 
he sharea more than ten years ago and which provided a corcise ana 
consistent set of guidelines for our cognitive assessments 

Dr. R. R. Skemp ana Dr. A. W. Bell for their helpful reactions 
to early arafts of the project proposal 

Dr. K. Hart for valuable consultative advice on cognitive 
assessment with interviews and paper-and-pencil tests 

Dr. K. Collis for his insightful remarks regarding connections 
between his research and the *CER Mathematics Profile Series 

Dr. J. F. Izard, J. Williams, and their colleagues in the 
Australian Council for Educational Research for their prompt and 
helpful responses to our requests and for permission to use 
assessment items from the ACER Mathematics Profile Series and AM 
Series 

Mr. G. Popowich for helping to get the project launched, for 
keeping us on track, and for providing valuable assistance and 
advice 

Dr. W. W. Zwirner, Dr. J. Holmes, and Dr. S. R. W. Brindley for 
timely aavice, assistance, and access to facilities for our data 
analyses 

E. Sawicki and R. Holmes who made nimerous direct and valuable 
contributions assisting the members of the Project Team 

The principals, teachers, and students in the Calgary schools 
in which we piloted and field-tested the interviews and 



9 



paper-ana-pencil tests, without whose cooperation we coula not have 
proceed ea 

?~e Teacher-Interviewers ana their stuaents, principals anci 
aamir.istrators, from many centres in Alberta, who playea a central 
role m the project 

The principals, teachers, ana stuaents in schools throughout 
the province who participatea in the paper-ana-pencil assessments, 
another essential component of the project 

The Calgary teachers who volunteerea to have their mathematics 
lessons and students observea to provide assessments of classroom 
cognitive demanas 

The Superintendents, Supervisors, Consultants, and principals 
who iaentified teachers for participation in the project 

The ACLIC Steering Committee for its helpful guidance, 
reactions ana advice during the term of the project; specifically: 
G. Ditto, W. Eddy, W. Hathaway, P. McLaughlin, G. Popowich 

Lois C. Marchand 
Marshall P. Bye 
Bruce Harrison 
Thomas L. Schroeder 




TABL£ OF CONTENTS 



Page 

FOREWORD i 

ABSTRACT ii 

ACKNOWLEDGEMENTS v 

TABLE OF CONTENTS vii 

LIST OF TABLES x 

LIST OF FIGURES xi 

LIST OF APPENDICES xiii 

OUTLINE OF THE STUDY 1 

Introduction 1 

Background , 1 

Review of the Literature 2 

How Children Learn 2 

Assessment of Pupil Cognitive Response Levels » ♦ ♦ 6 

Assessment of Curricular Cognitive Demands 9 

Teaching Tailored to Personal Schemas 10 

Purpose and Problems Examined 12 

The Scope of the Study 12 

Definitions of Terms 13 

Research Methodology 17 

Major Sources of Data 20 

Cognitive Response Assessment: Interviews 20 

Cognitive Response Assessment: Paper-and-pencil Tests 37 

Cognitive Demand Assessment: Curriculum Objectives 44 

Cognitive Demand Assessment: Textbooks 44 

Cognitive Demand Assessment: Classroom Observations 44 

Analysis of Data 46 

O vii 

ERJC , , 



FINDINGS OF THE STUDY **9 

Cognitive Levels of Students 1 Responses **9 

Numerator 

Operations 51 

Measurement 51 

Geometry and Graphing 51 

Cognitive Levels of Students 1 Responses by Grades 55 

Curricular Cognitive Demands 55 

Cognitive Demands of Curriculum Objectives 55 

Numeration 58 

Operations 58 

Measurement 58 

Geometry & Graphing 58 

Cognitive Demands of Prescribed Textbooks 61 

Numeration 61 

Operations 61 

Measurement 61 

Geometry & Graphing 63 

Cognitive Demands of Classroom Observations 63 

Numeration , 63 

Operations . . . . 65 

Measurement 65 

Geometry & Graphing 65 

Cognitive Demands of Provincial Achievement Tests 68 

Grade 3 68 

Grade 6 . * • 68 



Cognitive Demands Compared with Student Cognitive Response Levels ... 70 
Numeration .••»••••««•••••< •••«••••••••• 10 



ERIC 



viii 

12 



Operations 7 1 * 

Measurement 77 

Geometry 4 Graphing 79 

DISCUSSION OF FINDINGS 85 

Number of Matches and Mismatches Between Demand and Response 

Distributions by Curriculum Strands 85 

Number of Matches and Mismatches Between Demand and Response 

Distributions by Demand Areas 90 

CONCLUSIONS 95 

RECOMMENDATIONS 101 

IMPLICATIONS FOR FURTHER RESEARCH 102 

BIBLIOGRAPHY 101 

APPENDICES 109 



ix 



ERIC " 13 



List of Tables 



Table 1: ACLIC Paper-ana-pencil Test Cognitive Item Characteristics . . 39 

Table 2: Numbers of Matches ana Mismatches between Demand and 

Response Distributions by Curriculum Strana 86 

Table 3: Numbers of Matches and Mismatches between Demand ana 

Response Distributions by Demand Area 91 



ERJC u BEST COPY AVAILABLE 



List of Figures 

Figure 1: Cognitive Levels of Pupils 1 Responses, Numeration 50 

Figure 2: Jcgnitive Levels of Pupils 1 Responses, Operations 52 

Figure 3: Cognitive Levels of Pupils 1 Responses, Measurement 53 

Figure Cognitive Levels of Pupils 1 Responses, Geometry ana Graphing . 54 

Figure 5: Cognitive Levels of Pupils' Responses, Grades 1 to 3 56 

Figure 6: Cognitive Levels of Pupils' Responses, Grades 4 to 6 57 

Figure 7: Cognitive Demands of Numeration Objectives 59 

Figure 8: Cognitive Demands of Operations and Properties Objectives ... 59 

Figure 9: Cognitive Demands of Measurement Objectives 60 

Figure 10: Cognitive Demands of Geometry and Graphing Objectives .... 60 

Figure 11: Cognitive Demands of Textbooks, Numeration 62 

Figure 12: Cognitive Demands of Textbooks, Operations 62 

Figure 13: Cognitive Demands of Textbooks, Measurement 64 

Figure 14: Cognitive Demands of Textbooks, Geometry and Graphing .... 64 

Figure 15: Cognitive Demands 'Observed in Classrooms, Numeration 66 

Figure 16: Cognitive Demands Cbserved in Classrooms, Operations 66 

Figure 17: Cognitive Demands Observed in Classrooms, Measurement .... 67 



Figure 18: Cognitive Demands Observed in Classrooms, Geometry & Graphing 67 
Figure 19: Cognitive Demands of Grade 3 Provincial Achievement Test ... 69 
Figure 20: Cognitive Demands of Grade 6 Provincial Achievement Test ... 69 



Figure 21: Curricular Demand and Pupil Response Contrasts: Numeration, 

Grades 1 to 3 71 

Figure 22: Curricular Demand and Pupil Response Contrasts: Numeration, 

Grades 4 to 6 73 

Figure 23: Curricular Demand and Pupil Response Contrasts: Operations, 

Grades 1 to 3 75 

Figure 24: Curricular Demand and Pupil Response Contrasts: Operations, 

Grades 4 to 6 76 



xi 



Figure 25: Curricular Demand and Pupil Response Contrasts: Measurement, 

Graaes 1 to 3 78 

Figure 26: Curricular Demand and Pupil Response Contrasts: Measurement, 

Graaes 4 to t 80 

Figure 27: Curricular Demand and Pupil Response Contrasts: Geometry & 

Graphing, Graaes 1 to 3 81 

Figure 28: Curricular Demand and Pupil Response Contrasts: Geometry & 

Graphing, Grades 4 to 6 83 

Figure 29: Percentage of Demand Distributions Significantly Higher or Lower 
than Student Response Distributions, by Grade 89 



ERLC 



xii 

16 



List of Appendices 



Appenaix 1 , : ACLIC Interview Record Sheets 109 

Appenaix 2: Cognitive Demand Level Criteria 1^9 

Appenaix 3: Student Performance on Provincial Achievement Test Items, 

Grades 3 and 6 157 

Appendix 4: Classroom Observation Form . 160 

Appenaix 5: Cognitive Demands of Curriculum Objectives 163 

Appendix 6: Cognitive Demands Observed in Classrooms i80 

Appendix 7: Cognitive Demands of Provincial Achievement Test Items, 

Grades 3 and 6 187 

Appendix 8: ACLIC Paper-and-pencil Test Item Characteristics ana Source 

References 190 

Appendix 9: Data Sources for Cognitive Levels of Response 200 

Appendix 10: Project Personnel 205 



ERLC 



xiii 

17 



ASSESSING COGNITIVE LEVELS IN CLASSROOMS (ACLIC) 
OUTLINE OF THE STUDY 
Introduction 

The Assessing Cognitive Levels in Classrooms (ACLIC) project was designed 
to produce a program evaluation and needs assessment of the 1982 Alberta 
Elementary School Mathematics Program in terms of comparisons between the 
levels of pupil cognitive response and the levels of curricular cognitive 
demand. As hypothesized, in some topics and at some grade levels, the 
distributions of cognitive demands made by the curriculum and its presentation 
correspond reasonably well to the distributions of student cognitive 
responses, but in some other cases there are striking mismatches. The 
mismatches are most often characterized by a lack of suitable material for the 
significant numbers of students who are still responding Preoperationally in 
mathematics, especially in the lower grades, but also by a lack of suitable 
material for the cognitively most able. The report which follows documents 
the theoretical and practical background of the Project, its research design, 
ana the detailed findings that have led to tl ^se and other assertions. The 
recommendations made on the basis of the findings contain practical 
implications for the curriculum itself and for classroom interpretations of 
the curriculum. 

Background 

At the heart of the ACLIC Project is a question that has frequently been 
asked in the mathematical education literature, past and present: Is there a 
reasonable fit betwee r the instructional demands implied by a mathematics 
curriculum and the response levels of which the intended students are capable? 
It has not been uncommon for teachers, from Kindergarten through university, 
to despair of ways to present mathematics "understandably" to the many who 
seem to find the subject more or less inscrutable. Although the 

1 
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demand/response question has very likely been asked as long as formal 
instruction in -nathematics has been offered, research techniques have been 
developea onl, recently for addressing the issue and for obtaining reliable 
data from which answers could be formulated . 

'One research study that has addressed a similar demand/response question 
in the context of Grade Seven and Grade Eight mathematics was the Calgary 
Junior High School Mathematics Project (CJHMP). Considerable gaps were found 
between student cognitive response levels and curricular demands in fraction 
and ratio topics. It was also found that process-oriented teaching materials 
could narrow the demand/response gap and improve student achievement and 
attitudes in these topics. 

In the ACLIC Project, cognitive assessment procedures were developed for 
the whole range of mathematics topics in the elementary school grades. These 
consisted fourteen individual interviews and eight paper-and-pencil tests 
drawn from the intellectual development work and clinical interviews of Jean 
Piaget, the mathematical development research of Kevin Collis (University of 
Tasmania), the mathematical interview and test construction work of Kath Hart 
(Chelsea College, London), interviews conducted and reported by Robert Davis 
(University of Illinois, Urbana), and the Australian Council for Educational 
Research (ACER) Mathematics Profile Series paper-and-pencil cognitive 
assessment tests based on Collis 1 research findings. 

Review of the Literature 

How Children Learn 

A basic concept in the work of Piaget and of Skemp is that of a schema, a 
cognitive structure which has reference to a class of similar action sequences 
from past experience (Harrison, 1969, p. 94; Flavell, 1963, pp. 52-53). A 
schema can be thought of as the structure common to all those acts that an 
individual considers to be equivalent. For example, if a child's experiences 
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have led him to believe that putting three obiects with four objects results 
in a group of seven objects, a basic schema has been constructed that will 
enable the child to understand that "3 + *» = 7." Any problematic situation 
requiring behaviour which is already generally represented in the child's mind 
is handled by being assimilated to the schema . Learning that "3 + = 7" is 
assimilated to the knowledge that 3 objects and 4 objects make 7 objects. 
Furthermore, a child with such an operational schema is in a position to 
understand that three hundred plus four hundred equals seven hundred without 
ever having to count out that many beads or matchsticks (Skemp, 1958, p. 70), 
However, when a child encounters a new situation in which none of the existing 
schemas appear to be appropriate, new relevant experiences are needed from 
which new or modified schemas can be built to accommodate to the new 
circumstances. As with life in general, an individual learns to adapt to a 
mathematical environment through the interplay of assimilation and 
accommodation. While it is clear that a child needs the relevant schemas to 
understand and to process situations that are obvious analogues or 
applications of structures built in the past, it is even clearer that the 
schemas must be well founded and understood if there is to be successful 
accommodation to new learning situations. Any teaching/learning design which 
can ensure that each individual will be able to build the prerequisite 
concepts, before or while tackling new learning tasks, promises to facilitate 
effective, enjoyable, useful, and transferable learning. Unfortunately, 
mathematics learning of this kind will inevitably be out of reach for those 
students encountering curricular demands that are usually or always 
significantly above the cognitive levels at which they are able to respond. 
The ACL1C Project was designed to provide assessments of pupil response 
levels, of curricular demand levels, and of the "goodness-of-fit" between 
responses and demands so that problems like the one just described 
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might be minimized. 

Piaget once stated that an individual's apparent failure to grasp the 

Tiost basic concepts of elementary mathematics stems not from a lack of any 

special aptitude but rather from inadequate preparation, with its inevitable, 

concomitant emotional blocking. He went on to point out that the frequent 

failure of formal education can be traced to the tendency to begin with 

language, illustrations and narrated action rather lhan real, practical 

action. Preparation for mathematics education must begin with the 

encouragement of concrete manipulations that foster awareness of basic 

logical, numerical, and measurement relationships. This practical activity 

needs to be systematically developed and amplified throughout the primary 

grades, leading to basic physical and mechanical experiments by the time 

secondary education begins (Piaget, 1951, pp. 95-98). In a similar vein, 

Eleanor Duckworth, discussing implications from Piaget ! s work, has said: 

You cannot further understanding in a child simply by talking to 
him. Good pedagogy must involve presenting the child with 
situations in which he himself experiments, in the broadest sense of 
that term — trying things out to see what happens, manipulating 
things, manipulating symbols, posing questions, and seeking his own 
answers, reconciling what he finds at one time with what he finds at 
another, comparing his findings with those of other children. 
(Duckworth, 1964, p. U97) 

A teacher who possesses a certain concept may find it difficult tc 
realize that a pupil does not. Oice a concept has been formed, it is so 
obvious to the possessor that it is perceived as part of the data in a 
situation in which the concept is appropriate. It is difficult to imagine 
perceiving the data in any other* way. An added difficulty arises because 
pupils can learn by rote all the required procedures in the early stages of 
concept learning so that whether or not they ar3 really developing the 
required schemas is not readily apparent. However, it is worth the effort to 
find out because, unless the pupil is provided with the appropriate kinds of 
repeated experience necessary to form the basic concepts and operations, 



verbal and blackboard teaching rfiil lead to rote memorisation . The concepts 
required for learning superordinate concepts will not be formed, and the 
student will be incapable of really understanding mathematics (Skemp, 1962, 
pp. 9, 10; 1960, p. 50). The ACLIC Project cognitive assessment materials 
were designed to help teachers become more aware of the concepts and cognitive 
processes that their pupils can or cannot use. Presumably, such information 
could help teachers to provide learning activities that are suited to the 
cognitive levels at which the students are able to respond . 

A disheartening picture of the long-term results of teaching that is 
continuously geared well above pupil response levels has been provided by the 
research of Louis Johannot 0947). Johannot found that, in trie great majority 
of the Genevan adolescents interviewed, abstract reasoning was absolutely 
artificial, merely pseudo-reasoning. Reasoning had been replaced by learned 
procedures and method types. The role that active, creative intelligence 
played was seen to be no more than a secondary one (Johannot, 1947, p. 113; 
Harrison, 1976 Translation, p. 101). More recently, small scale trials in 
Calgary of Johannot f s interview tasks have given ample indication that the 
situation is little different across an ocean and thirty years later (e.g., 
Tyrell, 1976). 

A concise and yet meaning-filled and useful contrast between the form of 
"reasoning" Johannot found and that which proponents of contemporary 
mathematics learning theory would prefer to see fostered, has been offered by 
Richard Skemp. He has dramatically contrasted instrumental understanding , 
characterized by using "rules without reasons," with relational 
understanding , "knowing both what to do and why." An instrumental approach 
to mathematics learning characteristically consists of (or stresses) the 
learning of rules for proceeding from given data to the correct answers to 
given questions (each sequent step is determined solely by the immediate 
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conditions) Oi the other hand, a relational approach to mathematics learning 
engages the learner in building a conceptual structure (schema) from which a 
variety of strategies for solving any given problem can be produced (Skemp, 
1978, pp. 9, 1*0. How to encourage relational learning is suggested by 
Skemp' s description of the way in which "schemas" are constructed by being 
"built 11 and "tested" in three different "modes." In Mode 1, a person builds 
schemas from direct experience and tests them by experiment against 
expectations in actuality (the environment in which one's physical actions and 
activities take place (Skemp, 1979, p. 21)). In Mode 2, schemas are 
constructed through communication with others and tested through discussion 
with others. Mode 3 schema construction proceeds "from within" by formation 
of higher order concepts, by extrapolation, by the use of imagination and 
intuition (creativity), and by testing according to internal consistency with 
one's "inner reality" of existing knowledge and beliefs (Skemp, 1979, p. 163). 

When mathematics teaching neglects the development of mathematical 
reasoning structures in favour of a steady diet of narrowly focused 
"explanations" and "exercises," it should come as no surprise that the 
development of relational thinking is found to be at a very low level. While 
mathematical strategies cannot be "given" to pupils, they can and must be 
built by the child through process-oriented experiences and discussions that 
are appropriate for the level of cognitive development the child has reached. 
It is important, then, to be able to assess the cognitive level at which a 
pupil is able to respond in a given mathematics context. 
Assessment of Pupil Cognitive Response Levels 

Interviews . The work of Piaget and his associates has provided a rich 
source of cognitive assessment tasks covering a wide range of contexts, 
including many relevant to school mathematics learning. A detailed search of 
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the Piagetian and neo-Piagetian literature resulted in a collection of 
interview tasks designed to assess student understandings of the key concepts 
and skills :o°.tainej : .n the 1982 Alberta Education Elementary Mathematics 
Curriculum Guide, Grades 1 to 3. Once suitable tasks were identified, the/ 
were edited, simplified, and adapted for use by the ACLIC 

Teacher-Interviewers. Capsule descriptions of all of the interview tasks used 
are given in the Major Sources of Data section of this report, under the 
heading "Cognitive Response Assessment: Interviews. ,! Also, the "Interview 
Record" sheets for each of the ACLIC interviews are contained in Appendix 1. 
Since the details for each interview are available elsewhere in the report, 
only a Strand-Topic listing with reference citations is given here. 



Strand Interview Topic (s) 

Numeration Equivalence; 

Pre-multiplication 



Fractions 



Serial, Ordinal, Cardinal 
Correspondence 

Place Value 



Operations Addition Concept 

Additive Composition 
Commutativity of Addition 
Pre-muitiplication 

Subtraction 

Measurement Length 
Time 
Weight 



Reference Source(s) 

Copeland, 1974a, pp. 137-139 
Copeland, 1974b, pp. 26-27 
Piaget, 1952, pp. 203-220 

P^aget, Inhelder & , c >zeminska, 
1960, pp. 302-3 r ,5 

Piaget, 1952, pp. 106-121 



Brown, Hart, Kucheman, 1984, p. 6 
Davis & McKnight, 1980 

Bye, 1975 

Piaget, 1952, pp. 185-186 

Schroeder & Bye, 1984 

Copeland, 1974a, pp. 137-139 
Copeland, 1974b, pp. 26-27 
Piaget, 1952, pp. 203-220 

Brown, Hart, Kucheman, 1984, p. 6 
Davis & McKnight, 1980 

Copeland, 1974b, pp. 64, 65 
Hart, 1981, pp. 11-12 
Piaget, 1969, pp. 188-195 

Piaget & Inhelder, 1974, pp. 183-202 
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Strand 



Interview Topic (s) 



Reference Source(s) 



Geometry 4 
Graphing 



Classification 
Inclusion 



Copeland, 1974b, pp. 39-^0 



Graphing 



Piaget, 1960, pp. 153-169 



i-OCl 



Piaget, 1960, pp. 209-225 



Order (Linear, Circular) 



Piaget, 1956, pp. 80-103 



Paper-* 



and-pencil Tests . While it was decided early in the ACLIC 



Project that the Grades 1, 2 and 3 cognitive response assessments could best 
be made with individual "Piagetian" interviews, paper-and-pencil cognitive 
assessments for the pupils in Grades 3 through 6 were considered feasible, 
largely on the basis of the successful development by Oislow (1976) of a 
multiple choice test for determining Piagetian developmental levels in the 
context of Ratio and Proportion and by Kieren (In Bye, Harrison & Brindley, 
1980) of a short answer paper-and-pencil test for assessing cognitive response 
levels in the context of Fractions. These two tests were designed for pupils 
of Junior High School age, but many of the items could be adapted for the 
upper elementary grades. Previous successes in designing paper-and-pencil 
tests for assessing Piagetian levels of response at the upper elementary and 
secondary levels have been reported by Tisher (1971) and Shayer (Shayer, 
Kucheman & Wylam. 1976). In each of the cases cited, comparisons between the 
paper-and-pencil test ratings and those based on individual interviews 
established that there was a high level of agreement (of the order of 80%) 
between the two modes of assessment. 

Following a lead in a personal communication from Professor Skemp, the 
ACLIC team reconsidered the work of Collis in Australia. A reference by Biggs 
& Collis (1982) to a ;aper-and-pencil test on Operations that had been 
constructed from Collis 1 cognitive interview findings led to obtaining from 
the Australian Council for Educational Research (ACER) the Operations test 
from the ACER Mathematics Profile Series (Cornish & Wines, 1978). Finding 
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that the Operations test items were compatible with the ACLIC Interview tasks 
and with the Operations and Properties topics of the Alberta Eienentary 
Mathematics Cur^i^ulum, the complete Mathematics Profile Series was obtained . 
The items used :r. the ACLIC assessments were selected according to difficulty, 
topic coverage, and cognitive response elicited. Four tests were constructed 
for Grade 3 & U, and four for Grades 5 & 6, covering Number, Operations, 
Measurement and Geometry & Graphing. 
Assessment of Curricular Cog n itive Demands 

A number of studies have assessed the cognitive demands of secondary 
science curriculum objectives and textbooks (e.g., Snayer, 1972; Lyon, 1979) 
but it is unknown if, outside of local studies, similar assessments have been 
conducted in the area of school mathematics. 

The Calgary Junior High School Mathematics Project (CJHMP; Bye, Harrison 
& Brindley, 1980) addressed the question of the cognitive demands of two topic 
areas in the Alberta Junior High School Mathematics Curriculun Guide: 
rational nirnbers and ratios. Two sets of cognitive demand level criteria were 
generated by inference from Onslow's "Ratio and Proportion" test, Kieren's 
"Fractional Number Thinking Test," and related Piagetian research literature 
on the two topics. The CJHMP research team extracted descriptions of 
characteristic responses at each cognitive level from the Oislow and Kieren 
test items and from related research study findings. The expectations of each 
curriculum objective, each textbook explanation or exercise, each classroom 
expectation, and each achievement Lsst item were matched (in terms of the 
least demanding interpretation) with the demand criteria that had been 
generated from the pupil response assessments. A similar approach was taken 
in generating the cognitive demand criteria for the ACLIC Project. 

With assessment devices for rating the cognitive levels at which students 
are responding in the various mathematics topic areas and with sets of 
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criteria for assessing the cognitive demands of the curriculum, it is possible 
to assess the "goodness-of-fit" between pupil responses and curriculum demands 
(See the Analysis cf Data section of this report for a detailed description of 
the statistical procedures used.). Knowing how the expectations or demands of 
the curriculum compare with actual student responses should provide a sound 
basis on which to "tailor" instruction to the pupils for whom it is intended. 
Teaching Tailored to Persona l Schemas 

In 1972, Jean Piaget gave an uncharacteristically direct set of 
recommendations to mathematics and science teachers regarding teaching methods 
and apparently "less able" students: 

... the so-called aptitudes of "good" students in mathematics or 
physics, etc., consist above all in their being able to adapt to the 
type of instruction offered thera, whereas students who are "bad" in 
these fields, but successful in others, are actually able to master 
the problems they appear not to understand—on condition that they 
approach them by another route. 

What they do not understand are the "lessons" and not the 
subject- Thus it may be— and we have verified it in many 
cases— that a student's incapacity in a particular subject is owing 
to a too-rapid passage from the qualitative structure of the 
problems (by simple logical reasoning but without the immediate 
introduction of numerical relations and metric laws) to the 
quantitative or mathematical formulation (in the sense of previously 
worked-out equations) normally employed by the physicist . . . even 
in mathematics many failures in school are owing to this excessively 
rapid passage from the qualitative (logical) to the quantitative 
(numerical). (Piaget, 1972, p. 17) 

He went on to recommend that teachers should not lecture, transmitting 
ready-made solutions, but should rather create situations which pose useful 
problems so that the child or adolescent can experiment to reconstruct basic 
principles (if not rediscover them). Furthermore, the teacher should be ready 
to provide counter-examples to help his students reflect on, and reconsider, 
hasty solutions. Such a teacher-organizer, acting as a mentor stimulating 
initiative and research, needs to know his own subject as well as being 
familiar with the nature of intellectual development (Piaget, 1972, p. 18). 

In a similar vein, a British researcher has captured the essence of what 
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is most important when instructional materials and methods are being chosen 

for fostering the development of relational thinking: 

If we are to foster intellectual development within the educational 
framework, then it is essential that the teacher critically examines 
the concepts underlying the subject matter he hopes to teach; he 
must also be aware of the approximate limitations set on 
understanding by the various stages of operational thinking . • • 
Piaget has shown that efficient learning cannot take place if new 
data is so far removed from the child's experience that 
accommodation cannot take place . There is every indication . . . 
that restructuring of thinking is more likely to be brought about by 
the child actively operating on his environment, rather than 
constantly thinking in a teacher directed situation. (Hughes, 1965, 
pp. 110-111) 

A key Piagetian concept highlighted by Flavell (1963, p. 368), maintains 
that intellectual development is marked by a gradual transformation of overt 
actions into mental operations. Helping pupils to perform actions with 
decreasing support from external objects can be facilitated by having them act 
on physical objects that exemplify given concepts, patterns, or operations; 
then on pictorial or semi-symbolic representations; then on imagined objects 
and operations while keeping symbolic records, and so on, until the abstract 
concepts emerge in a form that can not only be used meaningfully but can also 
be reinterpreted, as required, in terms of previous levels of representation 
(rather than existing purely at a symbolic level). 

Teaching can cooperate with and guide learning by taking into account 
student developmental levels in the topics at hand and choosing methodology 
accordingly, by creating situations that pose useful and challenging problems 
for stjdents to investigate, by encouraging the search for patterns, and by 
arranging for students to encounter counter-examples while testing hypotheses 
and building abstractions, generalizations and formalizations. 



ERLC 



Purpose a nd Problems Examined 
The purpose :f the ACLIC Project was to gather evidence to provide 
wers to three research questions: 

1) What levels of cognitive response are demonstrated in mathematics 
topic contexts by Alberta students in each of Grades 1 through 6? 

2) What are the levels of cognitive demand made on w^udents at each grade 
level by: 

i) the curriculum objectives identified by the Elementary Mathematics 
Curriculum Guide , Alberta Education, 1982, 

ii) the prescribed textual resources, 
iii) teacher presentations, and 
iv) representative achievement tests? 

3) How well do the distributions of curricular demands (made by the 
curriculum objectives, texts, teacher presentations, and tests) fit the 
distributions of student cognitive responses at each grade level in each 
mathematics topic strand? 

The Scope of the Study 

A Steering Committee consisting of representatives from the Calgary Board 
of Education's Mathematics Team, Alberta Education, and the Calgary Catholic 
Board of Education was established to assist in charting the course of the 
project. The Project Director was the Calgary Board of Education Mathematics 
Specialist and the ACLIC Research Team members were University of Calgary 
mathematics education instructors and a teacher pursuing graduate studies. 

The project sampled curricular cognitive demands and student cognitive 
response levels from the six elementary school grades and across five 
mathematics topic strands: Numeration, Operations and Properties, Measurement, 
Geometry, and Graphing. 
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Students were selected from across the province to ensure a sample that 
was provincially representative, including an appropriate urban/rural balance. 
In all, 176" interview task assessment* were made of the responses from 360 
Graae 1 to 3 students who were interviewed by 23 Teacher-Interviewers . 
Grade 3 to 6 student response levels were assessed by means of eight 
paper-and-pencil tests that were completed by 1677 students. 

All 36U of the objectives stated in the 1982 Alberta Education 
Elementary Mathematics Curriculum Guide were rated as to level of cognitive 
demand by using the Cognitive Levels definitions stated on the following pages 
and the Cognitive Demand Level Criteria summarized in Appendix 2. The same 
cognitive demand criteria were used to rate all of the explanations, problems, 
and exercises in two of the authorized elementary school mathematics textbooks 
at each of the six grade levels (62 306 items were assessed altogether) , At 
each grade level one of the texts assessed was from one of the two series most 
often chosen by Alberta schools, and the other was from one of the remaining 
authorized series. Using the same criteria, cognitive demand assessments were 
made of 36 classroom lessons in mathematics (A total of 1586 minutes of 
classroom lessons were observed.). All 95 of the items in Parts A and B of 
the 1982 Grade 3 and 1 983 Grade 6 Alberta Mathematics Achievement Tests were 
rated for cognitive demand (Purely computational items were not included.). 

Definitions of Terms 

Achievement 

In this study the term "achievement 11 is used to refer to learning that 
focuses on the mastery of facts, skills, concepts, or routine 
problem-solving strategies (Biggs and Collis, 1982). Achievement is 
associated with instrumental understanding, using rules without reasons 
(Skemp, 1978), and with the kind of surface learning that arises from 
committing to memory for quick recall various facts, names, definitions, 

ERIC 30 



rules, . . . (Bell & Shiu, 1981) 
Cognition 

In contrast with "achievement", the term "cognition" is used to refer to 
the capability of using skills, facts, or concepts in a way that demonstrates 
understanding of what has been learned, such as, for example, in solving a 
problem, carrying out a task, or making a judgement (Bell & Shiu, 1981). 
Cognition is associated with relational understanding, knowing both what to do 
and why (Skemp, 1978), and with the kind of deep learning characterized by the 
making of connections in memory, by the construction of a conceptual structure 
from which a variety of strategies for solving given problems can be produced, 
by the recognition of similar relations in new situations, and by the 
development of strategies for directing mental processes (Bell & Shiu, 1981; 
Skemp, 1978). 
Cognitive Levels 

The following Cognitive Levels criteria have been edited from a summary 
of "Piaget's Structure" (Lovell, K., personal communication, 1974) • They were 
used to ensure consistency in the selection, development, and interpretation 
of the individual student interviews, the paper-and-pencil tests, and the 
cognitive demand criteria. 

Preoperational (PO) thinking is characterized by intuitive and 
transductive thinking from one particular to another, thinking limited by the 
particular state of the situation considered, isolated centrings on one 
feature only, dealing only with one problem at a time, inability to relate one 
problem to another in the same situation, unsystematic, partial, fragmented, 
inconsistent thinking, and lack of reversibility of thought (inability to work 
back from an inconsistency) . 

Early Concrete Operational (EC) thinking is characterized by faulty 
inductive and deductive logic, generally unsuccessful attempts to consider or 
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relate more than one feature of a situation, attempts at reversibility that 
end in confusion, incomplete or inconsistent attempts to classify facts, and 
uncertain judgements. 

Late Concrete Operational (LC) thinking is characterized by inductive and 
deductive logic limited to concrete situations which involve visual or sensory 
data, successful classification of tangible data, successful systematic 
thinking and relating of two or more facts without extension or generalization 
from one concrete field to another, reversibility when concrete data are being 
operated with, a tendency to judge purely verbal problems and problem 
situations in terms of their content as specifically related to personal 
experience, and concentration on relating things visibly or tangibly present. 

Early Form a l Operational (EF) thinking is characterized by reasonably 
advanced and consistent inductive and deductive logic limited by the concrete 
elements in the situation, generally unsuccessful attempts at abstract and 
propositional thinking, and generally unsuccessful attempts to go outside of 
known data to form hypotheses. [The ACLIC Team found the term Concrete 
Generalization, which has been proposed by Collis (Biggs & Collis, 1982, p. 
19), useful when characterizing and identifying Early Formal responses and 
expectations.] 

Formal Operational (F) thinking is characterized by hypothetical and 
deductive thinking, consideration ot data in terms of provisionally true or 
false propositions to be tested out in thought, logical thinking in symbolic 
and abstract form, recognition of the incompatibility of certain facts with an 
hypothesis, evidence of a preference to begin consideration of a situation 
with a theory rather than just the facts, and reasoning by implication at an 
abstract level. 
Cognitive Demand Levels 

The Cognitive Demand Levels used in this study have been generated using 
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the Piagetian Cognitive Levels criteria described above. The Cognitive Demand 
Level criteria were derived, in the first instance, by assessing the cognitive 
expectations of each of the objectives in the Alberta Education Elementary 
Mathematics Curriculum in terms of the kind of student response required for 
successfully reaching the objective. These response expectations (demands) 
were rated as Preoperational, Early Concrete Operational, Late Concrete 
Operational, Early Formal Operational, or Formal Operational according to the 
criteria in the Cognitive Levels definitions, the assessment criteria in the 
ACLIC student interviews, and the items in the ACLIC paper-and-pencil tests. 
Briefly, the Cognitive Demand Level criteria consist of specific subject 
matter examples of levels of pupil cognitive response expectations. A 
detailed listing of the Cognitive Demand Level criteria is included in 
Appendix 2. 

Cognitive Response Levels 

The ACLIC Project interview tasks and test items were chosen or designed 
to provide cognitive assessments that conform with the criteria contained in 
the Cognitive Levels definitions described above. In each cognitive 
assessment the student's responses were rated as Preoperational, Early 
Concrete Operational, Late Concrete Operational, Early Formal Operational, or 
Formal Operational . 
Concrete Generalization 

Concrete generalization is a term used by Collis (Biggs & Collis, 1982, 
p. 19) to identify Early Formal responses that are transitional from Concrete 
to Formal. Such responses are characterized by the ability to generalize 
concrete patterns and to cope with formal structures, but only in concrete 
embodiments (Cornish and Wines, 1977, pp. 16, 17). 
Operation 

A cognitve "operation" is an interiorized, reversible action that is 
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coordinated with other interiorized actions in the structure of a group 
containing certain laws that apply to the whole, (Battro, 1973, 121) 
"Operation ... is nothing but an articulated intuition rendered mobile and 
entirely reversible, because it was emptied of its representative content and 
subsists as simple 'intention 1 . . (Piaget, 1970, 26; Battro, 1973, 122) 
"Operations are reversible because they contain everything possible, whereas 
reality is irreversible to the degree that it is drawing only a sample from 
among these possibilities/ 1 (Battro, 122) 

Res earch Methodology 
Essentially, the Project was conducted in two phases, each roughly one 
year in duration, as described in the following paragraphs. 

Phase 1 (Year 1), The Developmental Phase 
Criteria were established from the research literature for identifying 
student levels of cognitive response to specific elementary school mathematics 
tasks • Relevant sources were searched for interview tasks and 
paper-and-pencil tests or items that could be used to identify the levels of 
student cognitive response. The ACLIC interview tasks, which were used in 
Grades 1 to 3, were drawn largely from the research of Piaget and from 
interpretations of the original research conducted by his group at the 
Institute of Education, University of Geneva. Testing specialists were 
consulted regarding suitable cognitive assessment test items, sample sizes, 
and statistical analyses. For Grades 3 to 6, eight paper-and-pencil tests 
(Grade 3/4 and 5/6 versions of tests covering Number, Operations, Measurement, 
and Space concepts) were developed by drawing cognitive assessment items 
primarily from tests developed by the Australian Council for Educational 
Research (Cornish & Wines, 1978) and also from the ACLIC interviews, the 
Chelsea Diagnostic Mathematics Tests (Brown, Hart & Kucheman, 1984), and the 
work of Robert Davis (Davis & McKnight, 1980). The choice and development of 
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the cognitive assessment instruments was guided by reference to the criteria 
contained in the definitions of the Cognitive Response Levels included in the 
Definitions of Terms section of this report. 

The inawidual interviews and the paper-and-pencil tests were field 
tested in five Calgary schools that were not included in liter parts of the 
Project. The information gained from the field testing proved invaluable in 
subsequent refinements of the assessment materials. 

Twenty-four teacher-interviewers were identified by Alberta Education 
Regional Mathematics Consultants, Mathematics Supervisors of various school 
districts, and Superintendents. In late August and early October, 1984, the 
prospective Teacher-Interviewers participated in four full days of workshops 
conducted by ACLIC personnel to prepare them for conducting the interviews as 
well as enabling them to have a part in the interview refinement process. The 
ACLIC interview workshops included analyses of video-taped sample interviews 
covering each of the major mathematics topics at each grade level as well as 
discussions of the interview procedures, criteria for rating the cognitive 
levels of student responses (as guided by the interview procedure/record 
sheets, copies of which are included in Appendix 1), and interview 
"role-playing" using the complete set of manipulatives that had been assembled 
for conducting each interview. 

One Teacher-Interviewer had to drop out before the ^tual interviewing 
began because of a shift to a new and especially demanding non-classroom 
assignment . 

A detailed schedule for student interviews, paper-and-pencil testing, 
cognitive demands analyses, and printing timelines was drawn up for Phase 2. 

Phase 2 (Year 2), The Assessment Phase 

Part of the evidence for Research Question 1 was gathered in October, 
1984, when each of the twenty-three Teacher-Interviewers conducted individual 
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interviews with fifteen Grade 1 to 3 students on four to six topics in two or 
more sessions totalling approximately one hour. Two of the 
Teacher-Interviewers agreed to interview an additional seven and eight 
students, respectively, so that the originally planned total of 360 
interviewed students could be accommodated. In a*l, 1767 interview 
procedure/record sheets were collected from 360 students in Grades 1 to 3. 
Among the materials assembled for the interviews were: counters, base ten 
blocks, dice ; specially prepared game boards, beads, weighted plasticine 
balls, "pacers" that clicked once every second, stopwatches, flowers, 
attribute blocks, and a variety of simple cut-outs and manipulatives. The 
rest of the data for addressing Research Question 1) was collected in 
November, 1984 when 1677 Grades 3 to 6 students resoonded to one of eight 
paper-and-pencil cognitive assessment tests covering Number, Operations, 
Measurement, or Space (Geometry & Graphing) at either the Grade 3/ 1 * or Grade 
5/6 level. 

Kolmogorov-Smirnov goodness-of-fit tests were used to assess the 
comparability of the distributions of cognitive level r itings of Grade 3 pupil 
responses to the interviews and to the paper-and-pencll tests. 

For Research Question 2), the cognitive demands (expectations) of the 
curriculum were assessed by analyzing: a) the objectives in the five content 
strands of the 1982 Alberta Elementary Mathematics Curriculum Guide , b) the 
corresponding parts of authorized textbooks, c) observations from classroom 
mathematics lessons, and d) the items in Parts A and B of the Grade 3 and of 
the Grade 6 provincial Mathematics Achievement exams. The curricular demand 
analyses were based on cognitive demand criteria derived from the criteria 
used to rate student cognitive response levels (i.e., those imbedded in the 
student interviews and in the paper-and-pencil tests as well as in the 
Cognitive Response Level definitions listed under Definitions of Terms} . 
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Appendix 2 contains documentation of the cognitive demand criteria that were 
used in the Project. 

Evidence pertaining to Research Question 3 (How well do the distributions 
of surricular demands fit the distributions of student cognitive response at 
each grade level in particular mathematics topic strands?) was obtained using 
Kolmogorov-Smirnov goodness-of-fit tests to compare the observed student 
cognitive response distributions with the corresponding curricular demand 
distributions. 

Major Sources cf Da ta 

The major sources of data in the ACLIC Project were: cognitive response 
assessment interviews, cognitive response assessment paper-and-pencil tests, 
and cognitive demand assessments of curriculum objectives, textbook materials, 
classroom observations, and Alberta Education Achievement Tests. 

Cognitive Response Assessment: Interviews 
Numeration Interviews 

Equivalence and Pre-multiplication (For Grades 1 and 2). Asked to 
distribute (10) flowers, one-for-one, into (10) vases and then seeing the 
flowers made into a "spread out" bouquet, the child was asked to distribute 
another (10) flowers into the vases. After these flowers were formed into a 
"tightly packed" bouquet, the child's concept of lasting equivalence was 
assessed by asking: "Are there as many flowers here [spread out] as there 
[tightly packed] ... or are there more in one of the bouquets?" The child's 
grasp of multiplicative composition was assessed by the question: "If we put 
all of the flowers in the vases with the same number in each vase, how many 
flowers will there be in each vase?" After a third set of (10) flowers was 
introduced, the question was repeated. 

A response indicating that a child considered one of the bouquets to have 
more than the other was rated as Preoperational in terms of concepts of 
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equivalence and multiplication. Accurate use of one-one correspondence but 
inability to predict the number of flowers per vase was rated as Early 
Concrete Operational. Consistent resistance to perceptual distraction and 
maintenance of the equality of the numbers of flowers in the bunches 
(e.g. ". . . because each was in its own vase") was rated as at least Late 
Concrete Operational. Successful prediction of the number of flowers per vase 
was rated as being at least at the Late Concrete Operational level in terms of 
multiplicative composition. (Copeland, 1974a, 137-139; Copeland, 1974b, 
26-27; Piaget, 1952, 203-220) 

The record sheet for this interview task, which cane to be called 
"FLOWERS," is included in Appendix 1. 

Fractions (for Grades 1, 2, and 3). The child was shown a strip of 
adding machine tape, longer than wide, and was told: "This is quite a thin 
piece of toffee. The bears (two "bear" stickers mounted on two white cards) 
want to eat it all up. To be fair, each should get just the same amount. How 
shall we do it? . . . You can use these (pencil, scissors, "sticks," . . .)." 
Then: "How did you do it?" (or, "Tell me what you did.") When the child had 
divided the whole, the following question was posed: "Would these pieces 
taken together make up as much as the whole strip of toffee that we started 
with ... or more ... or less?" . . . "Tell me why." Then, a third bear 
was brought out and the problem reposed with a new strip of adding machine 
tape. Alternatively, the procedure could be started with three bears. As 
appropriate, the procedure was repeated for quarters, fifths, or sixths. 

At the Preoperational level of response the child experiences real 
difficulty trying to divide the toffee into two equal parts, ending up with, 
for example i more than two parts, or approximately equal small portions with 
some of the toffee undivided, or all of the toffee shared unequally, or three 
portions (confusing the nimber of cuts with the number of parts). Early 
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Concrete Operational responses are marked by successful production of two 
equal parts but without realization that the original whole must necessarily 
equal the sjt. :f its original parts ♦ The ability to make 3 equal parts and to 
intuitively (not operationally) realize that there is conservation of the 
whole is rated Late Concrete Operational. Early Formal Operational responses 
characteristically involve handling the trichotomy (three equal parts) problem 
by means of an anticipatory schema (i.e., an a priori understanding of the 
relations between the fractions sought and the original whole) and operational 
conservation of the whole. At this level, division into fifths and sixths is 
also handled by means of an anticipatory schema. (Piaget, Inhelder & 
Szeminska, I960, 302-335). 

The record sheets for this task, which came to be called "TOFFEE." are 
included in Appendix 1. 

Serial f Ordinal, Cardinal Correspondence (For Grade 1). In this 
interview (based on Piaget, 1952, 96-121), the child was presented with ten 
toy drums, graduated in size (the largest at least twice the size of the 
smallest) but in disarray, and ten "drumsticks" (wooden toothpicks, each cut 
to match the radius of the drum to which it belongs) . Information about the 
child's notions of serial, ordinal, and cardinal correspondence was gathered 
from the responses to the following five questions and related procedures: 
Question 1: "The drums are going to be in a parade. Arrange the 
drums and drumsticks so that each drum is with the right size of 
drumstick." [Interviewer Note: Discuss until it is clear that the 
child understands the principle of serial correspondence.] 

Question 2: [Interviewer Note: Once the rows of drums and 
drumsticks have been arranged in correspondence with one another, in 
clear view of the child, move the drums closer to one another and 
the drumsticks further apart, but maintaining the distance between 
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the rows of drums and drumsticks. Then, touching one of the druns 
. . .] "Which drumstick will go with this one?" [Repeat, 
choosing m order or at random according to how the child answers.] 

Question 3: (.Interviewer Note: After several repetitions of 
Question 2, reverse one of the series.] "Which drunstick will go 
with this one?" [As in Question 2] 

Question 4: [One or both series disarranged] "Which drumstick 
belongs to this drum?" 

Question 5: (Which enables determination of "the exact level of 
the child's understanding" (Piaget, 1952, 98)) [Interviewer Note: 
Mingle all of the elements of the two series. Pick out a drum, say 
number 5.] "Some of the drums are going in the next parade, but not 
all of them—only those that are bigger (or smaller) than this drum. 
Find the drumsticks belonging to the drums that are going in the 
parade and those belonging to the drums not going." 
These five questions, posed separately to the child, were reduced to 
three more general problems for systematizing the results (in accordance with 
Piaget, 1952, 98): 

1. constructing a serial correspondence or similarity (Q. 1) 
?. determining a serial correspondence when it is no longer directly 
perceived (transition to ordinal correspondence) (Q. 2 and Q. 3) 

3. reconstructing the ordinal correspondence when the intuitive series 
are destroyed (Q. M and Q. 5) 

Regarding the child's ability to construct a serial correspondence (Q. 
1), inability to make the drums and drumsticks correspond and inability to 
form the two individual series were rated as Preoperational responses. An 
Early Concrete Operational response features spontaneous construction of the 
correct series, following some trial and error, and successful solution of the 



problem of serial correspondence (especially by the method of double 
seriation) (Piaget, 1952, 102, 103). Late Concrete Operational responses are 
characterized oy the child continually considering the set of relationships 
among all of tne elements, at each new step looking for the biggest (smallest) 
of the remaining elements (no trial or error). Responses at this level 
frequently demonstrate an obvious ease of operation including establishing the 
correspondence immediately, without previously seriating the druns and 
drumsticks (Piaget, 1952, 106) 

Regarding assessment of the child T s ability to move from serial to 
ordinal correspondence (Q. 2 & Q. 3), a characteristic Preoperational response 
would have the child losing all notion of correspondence when one of the 
series is displaced, merely matching elements that happen to be opposite one 
another. Early Concrete Operational responses include attempts to find the 
correct correspondence "by empirical means or by counting" (Piaget, 1952, 106) 
hampered by constant confusion between the correct position and that of the 
preceding cne. Solving the problem by coordinating estimates of the required 
position with that of the cardinal value of the sets in question (involving 
both qualitative serial and ordinal numerical correspondences) is rated a Late 
Concrete Operational response (Piaget, 1952, 106-114). 

The child's attempts to reconstruct a cardinal correspondence (Q. 4 & Q. 
5) are rated Preoperational when no correspondence is made, when the series 
are not reconstructed, or when "matching" elements are chosen at random. 
Early Concrete Operational responses include problem solution attempts that 
lack systematic re-seriation or cardination. Late Concrete Operational 
responses typically involve achieving reconstruction of the series by 
co-ordinating ordination and cardination (Piaget, 1952, 115-121). 

The record sheets for this task, which was called "DRUMS," is included in 
Appendix 1. 
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Subtraction/Place Value (Brown, Hart & Kucheman, 198*1; Davis & McKnight, 
1980). This interview explores subtraction concepts as well as place value 
ideas and it, is described under Operations and Properties I nterviews , which 
follows . 

Operations and Properties Interviews 

Addition Concept ( Invar iance, Reversibility). (For Grade 1) The 
materials for this interview consisted of 11 toy cars (seven of one color, 
four of another) and a mat on which was drawn a "parking lot" with 11 parking 
spaces. The interviewer began parking the seven cars in the first seven 
stalls demonstrating one-to-one correspondence, and invited the child to 
continue parking the rest of the cars. Next all the cars were driven out of 
the parking lot. Then the cars were parked again, this time beginning with 
the ones of which there were four. After the four cars of one color and one 
of the remaining seven cars were parked, the interviewer asked, "If you finish 
parking all the cars, will all the stalls be full?" and, if yes, "Will there 
be any cars left over?" If both these questions were answered correctly, the 
child's response was rated as at least Early Concrete Operational. If the 
child was unable to construct the one-to-one correspondence between stalls and 
cars, or if he was unable or unwilling to predict whether the spaces would be 
full, or if he predicted incorrectly, the response was rated as 
Preoperational. This task was adapted from an unpublished working paper (Bye, 
1975). 



The record sheet for this interview, called the "PARKING" task, is 
included in Appendix 1. Note that the responses listed on the record sheet 
under Early Concrete Operational were actually classified as Preopertional , 
while those listed under Late Concrete Operational were actually classified as 
"at least Early Concrete Operational." 



Additive Composition (Invariance, Sharing) ♦ (For Grades 1 and 2) The 
first task of this interview (additive composition and invariance) was 
conducted by the interviewer telling the following story while demonstrating 
with poker chips placed on a card with two halves marked "Yesterday" and 
"Today." There is a boy (girl) whose mother makes cookies he likes very much. 
Every morning he asks his mother for cookies to take to school. Yesterday his 
mother gave him four cookies to eat at recess. In the afternoon he asked for 
cookies again and mother gave him four more cookies to eat in the afternoon. 
Today he asked for cookies in the morning and his mother gave him four, and in 
the afternoon he asked for cookies and again his mother gave him four. Now, 
yesterday he ate four cookies in the morning and four more cookies in the 
afternoon. But today he was so busy at recess he only had time to eat one 
cookie. So he saved the rest of the cookies to eat in the afternoon 
(demonstrated by moving three cookies over next to the four for today's 
afternoon) . 

The interviewer then asked, "Did the boy have more cookies yesterday 
(pointing to all of yesterday's cookies) or more cookies today (pointing to 
all of today's cookies) or did he have the same on both days?" 

The response of a child who did not know or was uncertain which day had 
more chips was rated as Preoperational. 

A child who initially chose one day as having more than the other but who 
when pressed for justification suggested counting and discovered that both had 
eight was rated as Early Concrete Operational. 

A child who knew that both days had the same number even without counting 
and who based his justification on the equality of the numbers or on a 
reversibility or identity argument was rated as Late Concrete Operational. 

The second task of this interview (sharing) involved 24 chips put into 
two clearly unequal piles. The interviewer asked, "Suppose I put these 
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cookies into two piles, these (the larger pile) for you and these (the smaller 
pile) for me, Would that be fair? What could you do with all these cookies 
to put the?, ir.-.c two piles so that it would be fair? 

lhe responses of children who judged the two unequal piles to be "fair" 
or who made the piles "equal" by estimation without counting or checking in 
any way were rated as Preoperational. 

Children who equalized the piles by a series of trials and errors and 
counted or matched to verify success were rated as Early Concrete Operational. 

Responses involving systematic sharing (e.g. putting all in one pile and 
removing two at a time) or using operations on nimbers were classified as Late 
Concrete Operational. (Piaget, 1952, pp. 185-186) 

The record sheet for this interview, called "COOKIES", is included in 
Appendix 1. 

Commutativity of Addition (For Grades 1, 2, and 3). The materials for 
this interview consisted of two identical open-top boxes, about 10 cm x 15 cm 
x 2 cm, separated into two compartments by a wooden divider. Each box held 2M 
small blocks which could easily be moved from one side of the box to the 
other. With all the blocks on the one side of the divider in each box, the 
child was asked whether the two boxes contained the same number of blocks. If 
necessary, counting the blocks was suggested. In the child's view the 
interviewer moved six of the blocks to the right side of one of the boxes and 
explained that in the other box some blocks would be moved but that the child 
would not be able to watch. The interviewer then arranged the boxes so that 
they were mirror images of one another and placed them side by side concealing 
the six blocks on one side of one box. 

The interviewer then asked "Can you tell me how many blocks are hidden 
under my hand?" and, if the answer sounded like a guess, asked questions such 
as: "Are you sure? Is there any way you could know for sure, instead of just 
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thinking there might be that many?" 

The responses of children who did not know or guessed or estimated were 
rated as Preoperational. Children who guessed six and supported this by 
reference to the six in the other box, but did not verify that the other sides 
of each box each had the same number (18), were rated as Early Concrete 
Operational. Responses in which the children determined that there were six by 
computation (e.g. 24 - 18 = N, 18 + N = 24, etc.), by counting on from 18 to 
24, or by noting the symmetry of the six and 18 in one box and the 18 and six 
in the other were rated as Late Concrete Operational. 

If it was necessary to verify child's method of solution, the interviewer 
took up one box and moved some blocks from one side to the other without the 
child seeing the moves, arranging the box with eight on one side and sixteen 
on the other. The box was then presented with the eight blocks covered. A 
child who noticed that there were fewer showing so there must be more hidden 
was said to be using compensation. If this idea was applied as an estimation, 
then the response was rated Early Concrete Operational. If the child argued 
that since there were two fewer showing (16 instead of 18), there must be two 
more hidden (10 rather than 8), the response was rated Late Concrete 
Operational. 

The record sheet for this interview, called DIVIDED BOXES (Schroeder & 
Bye, 1984), is included in Appendix 1. 

Equivalence and Pre-multiplication (Co pel and 1974a, 137-139; Copeland, 
1974b, 26-27; Piaget, 1952, 203-220). This interview covers concepts of 
numerical equivalence and foundational ideas for multiplication. It is 
described under Numeration Interviews . 

Subtraction/Place Value (For Grades 1 to 3). This interview began with a 
game using base ten blocks to ensure that the child had some familiarity with 
structured units, tens, hundreds, . . . material. Third grade children were 
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then asked: 1) to show 365 with the blocks, 2) to read 699, 3) to write the 
successor of 699, and 4) to write the number 2 less than 300 [Tasks 3) and 
were suggested by items in a Chelsea Diagnostic Mathematics Test (Brown, Hart, 
Kucheman, 1984, 6)]. Then, the following tasks were posed: 5) 527 - 332, 6) 
702 - 25, and 7) 4 002 subtract 25 [ 6) and 7) were suggested by Davis and 
McKnight, 1980) ] with the child being encouraged to describe what was done, 
and why, and to use the blocks, if needed. Second grade children were taken 
as far as task 6), but, the numbers 365, 699, 699, and 300 were replaced by 
36, 69, 69, and 50, respectively, and 527 - 332 and 702 - 25 were replaced by 
32 - 18 and 102 - 25. At the Grade 1 level only tasks 1) to 4) with the 
numbers 36, 39, 39, and 20 were used. 

Correct responses to one or more of 1) to 3), only, were rated as Early 
Concrete Operational. Correct responses to 4) and/or 5), in addition to the 
preceding, were rated Late Concrete Operational. Correct responses to 6) or 
7) (with some explanation of the procedure, with or without blocks) were rated 
Early Formal Operational. 

The record sheets for these interview tasks, which were called "BL0CKS1 , !l 
M BL0CKS2," and ,l BLOCKS3, rt respectively, are included in Appendix 1. 
Measurement Interviews . 

Length (For Grades 1 and 2). This interview, concerned with conservation 
of length and comparison of length, was conducted using two sets of task 
cards. The first set (cards A1 to A6) was adapted from an unpublished working 
paper (Bye, 1975); the second set was based on items constructed for the 
Concepts in Secondary Mathematics and Science (CSMS) project (Hart, 1981, 
pp. 11-12). 

Glued onto each of the cards in set A were two identical wooden sticks 
(about 1 nm x 5 mm x 100 ran) . The sticks were placed in various orientations 
as is shown in the diagrams in Appendix 1. To begin the task, the interviewer 



gave the child several loose sticks identical to those on the cards and 
explained that the cards to follow had sticks like those glued onto them. As 
each card was presented the interviewer asked, "Are these two sticks both the 
same length or is one stick longer than the other? Which one is longer? Can 
you tell or show me how you know?" 

The cards in set B each contained two lines drawn on one centimetre 
squared paper. On cards B1 to B4 the two lines were of different lengths but 
their endpoints were vertically aligned. The two lines on card B5 were the 
same length but their endpoints were not aligned. As each card was presented 
the same set of questions was asked as for set A. 

As the interviews proceeded the interviewer made note not only of whether 
the answers were correct but also of the reasons given in response to the 
question, "How do you know?" Characteristic modes of thinking demonstrated by 
students in responding to the question are listed below. Each child's overall 
response for each of the two sets of tasks was rated as Preoperational, Early 
Concrete Operational, or Late Concrete Operational according to the levels of 
cognition predominating in the responses to each set. 

When children based their judgements on perception, or focused on 
endpoints in isolation without taking into consideration the relation of the 
opposite endpoints (set A) or the shape of the line in between (set B) , their 
responses were rated as Preoperational. Typically these children judged the 
sticks on card A2 and the lines on card B5 to be unequal because one end of 
one extends beyond the corresponding end of the other, while the lines on 
cards B1 to B4 were considered to be equal in length because the ends matched. 

Responses of children who considered both ends of each line and attempted 
to coordinate relationships between corresponding endpoints were rated as 
Early Concrete Operational. For example, some such children "measured" using 
a stick or strip of paper to check the alignment of the ends rather than 
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placing the measuring tool along the lines. 

Children who correctly completed all or most of the tasks using measuring 
tools placed along the lengths of the objects to be compared and argued that 
since each object matched the same length on the measuring tool the objects 
themselves must match (transitive reasoning) were rated as Late Concrete 
Operational. Responses involving small errors using measuring tools and 
judgements that the sticks in set A differed very slightly in length were 
considered Late Concrete Operational as long as the logic was essentially as 
described above. 

The record sheets for this interview, called LENGTH, are included in 
Appendix 1. 

Time (For Grades 1, 2, and 3). The child was first asked to Count up to 
15 along with the clicks produced by a "pacer" tone click per second] and to 
notice how far the hand of a stopwatch had moved by the end of the count 
[i.e., to the 15 seconds mark]. 

Then the stop-watch was masked and the instructions given to the child 
were: "Count up to 15 again, but this time twice as quickly . . . count two 
numbers to every click .... How far do you think that the Chidden] hand of 
the stop-watch went while you were counting faster? Why?" The following 
questions were also asked. "Does counting quickly take more time than 
counting slowly ... or less time ... or the same amount of time?" "Does 
the watch go more slowly at one time and more quickly at another ... or does 
it always go the same?" 

Responding that the stop-watch hand runs more or less rapidly according 
to the speed of work being timed (in this case, "counting to 15") was rated 
Preoperational. Inability to correlate the work done by oneself (the count of 
15) with the steady motion of the stop-watch hand (appreciation of the 
conservation of velocity but inability to apply it to more than one moving 
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body) , refusal to make any predictions on the grounds that it is impossible to 
do so, inability to ascribe a unique unit of time or a common duration to 
motions having iifferent velocities, or comparing the two counting speeds 
directly without reference to the watch was rated Early Concrete Operational. 
Late Concrete Operational Responses are characterized by predictions that the 
hand will stop before 15 (realizing that the speed ol the watch is not 
affected by the speed of the work timed) accompanied by inaccurate guesses. 
Early Formal Operational responses include predictions of 7 1/2 (exact 
correlation between task duration and displacement of stop-watch hand) and 
approximately 7 1/2, with a logical explanation. (Piaget, 1969, 188-195). 

The "TIME" interview record sheets are included in Appendix 1. 

Weight (For Grades 1, 2, and 3). In Task One the child was asked to 
order by weight three plasticine "pebbles" whose weight could not be guessed 
from their volumes. A balance scale was available. Only two pebbles were 
allowed to be touched at the same time. In Task Two, three pebbles, the 
smallest being the heaviest, the largest the lightest, were given to the child 
to order from lightest to heaviest. In Task Three the child was first given 
six pebbles whose weights could not be determined by inspection alore and, 
then, three pebbles of identical volume but differing weights. Each time the 
child was asked to "arrange in order from lightest to heaviest by weighing two 
at a time." In Task Four the child was asked to arrange ten pebbles of the 
same volume but different weights in order from lightest to heaviest. In Task 
Five the child was asked to identify which of three identical matchboxes was 
the lightest and which the heaviest in each of three situations described as 
follows: 1) Box A is heavier than Box B and Box B is heavier than Box C, 2) 
Box A is heavier than Box B and Box C is lighter than Box B, and 3) Box B is 
lighter than Box A and heavier than Box C. 

An Early Formal Operational response, indicating that the concept of 
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weight seriation is fully developed, is characterized by correct order ings in 
all cases with only minor errors, if any. Correctly coordinating all of the 
weight relations in Tasks One and Two, correctly seriating in Task Four, but 
showing inability to coordinate the inverse relations in Task Three mark Late 
Concrete Operational responses. An Early Concrete Operational response is 
exemplified by an empirical approach to Task Four and failure to coordinate 
successive constructions. In Task Three it is established that A>B ?nd OD 
but that this does not tell anything about the other relations between A, B, 
C, and D. In a typical Preoperational response, Task One and Task Two are 
answered incorrectly because the pebbles are weighed one at a time and without 
any correlation. Both Preoperational and Early Concrete Operational responses 
are often based on size considerations, as when the child not^s that "Pebble A 
is heaviest but it is lightest because it is smallest." The student responses 
were assigned cognitive level ratings on the basis of the overall patterns of 
response to the various subtasks contained in the Weight interview. (Piaget & 
Inhelder, 1974, :33-202). 

The record sheet for the "WEIGHT" ..ask is included in Appendix 1. 
Geotne^ y and Graphi ng Interviews 

C .lo ss i f ica t i on , Incl usi on (For Grades 1, 2, and 3). A set of geometric 
solids was placed on the table. The child was asked to sort them into tvo 
piles so that "things in each group are alike in some way." Then the child 
was asked "Hov are all the oDjects in this group alike?" The procedure was 
repeated but with the request that the objects be sorted in another way. Task 
Two was conducted with red and blu^ cardboard cutouts of squares and circles. 
After establishing that the child knew which were squares and which were 
circles, the inter /iewer asked two questions; 1) Are all the circ js blue? 
and 2) Are all the blue ones circles? . . . Why? Grade 2 and 3 children were 
given an additional task consisting of a repetition of Task One with the 
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solids replaced by large and small, single-thickness attribute shapes . 

A typical Preoperational response shows inconsistency in naming an 
attribute common to all of the objects in a group and inability to consider an 
entire group of objects simultaneously in order to name a single common 
attibute. An Early Concrete Operational response is characterized by one or 
two different groupings of the objects but with an inability to identify the 
common attributes of each group. Lace Concrete Operational responses clearly 
show evidence of flexible thinking m the classification tasks and ir the 
identification of attributes in each subgroup formed. Late Concrete 
Operational responses include correct use of the concept of inclusion in Task 
Two. Interpreting the question "Are all of the circles some of the blues?" as 
"Are all the circles all the blues?" is rated as Early Concrete Operational. 
A Preoperational response is characterized by the child's inability to 
separate the circles as a class from the whole collection. ,f All" can only 
mean "the whole set of objects" at the Preoperational level of response. 
(Copeland, 197Mb. 29-40). 

The record sheets for the Classification, Inclusion ta3k, which was 
called 'SORTING," is included in Appendix 1. 

Graphinr (For Grade 3). For this interview, which was concerned with 
locating a point in two-dimensional space, the materials were sheets of plain 
white rectangular paper, a thirty-centimetre ruler (marked in centimetres 
only), an unmarked stick, strips of paper, lengths of string, pencils and 
markers. TVo identical sheets of paper were placed at opposite corners of a 
table. On one of them a point, P, was marked ir *ed about halfway between the 
centre of the rectangle and one of its corners. The child was asked to mark a 
point on the second sheet in the same position as P on the first, so that if 
the second sheet were placed on top of the first, the two points would 
coincide. The children were encouraged to use whichever of the measuring 
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tools they wished. After the first attempt the sheets were superimposed and 
the results evaluated. Children were then given a chance to try again if they 
wished. 

Children's responses were rated as Preoperational it they placed their 
point by visual estimate and made no use of the materials provided and no 
attempt to measure. 

Responses were rated as Early Concrete Operational if the point was 
located visually and measuring devices were used perceptually and 
inappropriately. Typical responses at this level involve measuring one 
distance only, either obliquely from one corner of the rectangle to the point 
or from one edge to the point. 

When, through a process of trial and error, children discovered the need 
for two-dimensional measurement, their responses were rated as Late Concrete 
Operational. 

When there was no trial-and-error behavior and the u .ild immediately 
coordinated the two rectangular measurements, the response was rated as Early 
Formal Operational. (Piaget, 1960, pp. 153-169) 

The record sheet for this interview is included in Appendix 1 under the 
name "DOT." 

Loci (For Grades 2 and 3). The child watched as the interviewer marked 
two points on a blank piece of paper, saying "Let's imagine these are trees. 
Where can you stand to be the same distance from either tree?" The child 
would indicate the positions. Next, the child was asked to do the same for 
two series of trees lying on lines perpendicular to one another. In the third 
task, the child was asked to place beads to show where the trees might be 
planted in order to be "the same distance" or "just as far" from the dot. 

A typical Early Formal Operational response demonstrates reasoning by 
recurrence, for example: After determining a few points in the series, the 
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child concludes that all points in the circle or straight line must have the 
same property. Typical Late Concrete Operational responses show only an 
"inkling" of the "locus" and are simply a> extension of the method used to 
place the first bead. There are occasional equidistant 3 errors due to 
overemphasis on continuing in a chosen direction and to disregard for 
considerations of symmetry. Early Concrete Operational Responses are 
manifested by one or two solutions estimated perceptually, but fairly 
accurately, or by various responses produced apparently at random and 
irregularly c In Task Three no attempt is made to measure. A Preoperational 
Response is illustrated by random choice of points without regard for 
distance. (Piaget, 1960, 209-225). 

The record sheet for the "LOCI" interview is included in Appendix 1. 

Order (Linear^ Circular) (For Grades 1 and 2). Shown a linear string of 
nine vari-coloured beads, the child was first asked to arrange a duplicate set 
of loose beads in the same order, then to arrange the loose beads in the 
reverse order, and, finally, to reproduce in linear order a string of twelve 
vari-coloured beads that were presented in a "figure 8" pattern. 

Correct responses to all of the tasks wore rated Late Concrete 
Operational, demonstrating an ability to order in both linear and circular 
arrangements, which requires the concept of reversibility. Correct responses 
to Tasks One and Two, only, were rated Early Concrete, indicating an ability 
to arrange in reverse order. An inability to coordinate a whole row of beads 
with a given linear ordering marks a Preoperational response. (Piaget, 1956, 
80-103) 

The record sheet for this interview, which came to be called "BEADS," is 
included in Appendix 1 . 



o 36 53 

ERIC 



ERIC 



Cognitive Response Assessment: Paper-and-Pencil Tests 
Eight different paper-and-pencil tests were developed: a Grade 3/ 1 * and a 
Grade 5/5 test for each of Number, Operations, Measurement, and Space 
(Geometry and Graphing) . Items were drawn, in the main, from tests developed 
by the Australian Council for Educational Research (ACER), the Mathematics 
Profile Series (MPS) and the ACER Mathematics (AM) Series, Other item sources 
were Brown, Hart, & Kucheman 098*0 and Davis and McKnight (1980). All of the 
items were 5->lected for assessing student cognitive response levels in 
accordance with the Cognitive Response Level criteria compiled by the ACLIC 
Team. The ACER items are based on cognition research by Collis (1972. 1975) 
and procedures have been established by ACER for connecting item performance 
with Piagetian levels. The other items were chosen according to the ACLIC 
criteria and were found to provide cognitive response assessments consistent 
with those of the ACER items. 

Appropriate items from the Grade 3 and 6 Alberta Education Achievement 
Tests were placed on seven of the eight ACLIC paper and pencil tests so that 
the performance of the Grade 3 to 6 students in the sample could be compared 
with that of Grade 3 and 6 students across the province. A series of 
chi-square goodness-of-fit tests was conducted to determine whether the 
differences between the performances observed among students in the sample 
were significantly different from what would be predicted from the item 
statistics produced in the large-scale testing program. These tests are 
reported in detail in Appendix 3. 

In comparing Grade 3 and 4 students actual performances on individual 
items with the results of the Grade 3 provincial test, 18 of the 30 
differences were not statistically significant. The Grade 3 ACLIC students 
who were approximately half a year younger than the Grade 3 students who took 
the achievement test performed significantly lower in seven of the 15 
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comparisons, but the Grade *4 students who were approximately half a 
ye?r older than the achievement test sample students scored 
significantly higher in three casrs and significantly lower in two 
cases. The Grade 5 students who were about a year and a half 
younger than the Grade 6 achievement test sample students scored 
significantly lower in 18 of 21 comparisons . But the Grade 6 
students who were about half a year younger than the students in the 
achievement test sample scored significantly lower in nine cases, no 
different in 11, and significantly higher in one case. 

From these results it is concluded that the students in the 
ACLIC test sample are probably representative of students in the 
same grade across the province. 

For each of the ACLIC paper-and-pencil tests, Table 1 lists the 
number of cognitive items, the mean itm difficulty, the 
reliability, and the nunber of students who wrote the test. The 
reliabilities as measured by Cronbach's alpha ranged from 0.653 to 
0.861, with a median of 0.717. Test reliabilities in this range are 
generally considered quite adequate in research of this sort 
(Nunnally,1967). 

The Number 3 A test contains 26 items, four from ACER MPS, 13 
from ACER AM, 3 from Brown, Hart, & Kucheman (1984), one from Davis 
& McKnight (1980), and 5 from the 1983 Alberta Education Grade 7 
Mathematics Achievement Test. 
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Table 1 

ACLIC Paper-and-pencil Test Cognitive Item Characteristics 



ACLIC Number Mean Item Reliability Number of 

Test of Items Difficulty (Cronbach Alpha) Students 



Number 3/1 


21 


0.539 


0.653 


209 


Operations 3/1 


20 


0.718 


0.861 


229 


Measurement 3/1 


28 


0.525 


0.706 


208 


Space 3/1 


25 


0.389 


0.661 


202 




Number 5/6 


21 


0.359 


0.665 


182 


Operations 5/6 


30 


0.683 


0.818 


186 


Measurement 5/6 


30 


0.U61 


C.728 


251 


Space 5/6 


31 


0.U78 


0.773 


215 



The Number 5/6 test contained 30 items, 21 from the ACER MPS and AM series and 
9 from the 1933 Alberta Education Grade 6 Mathematics Achievement test. The 
number tests call for students to respond to items relating to representation 
of number, place value, expanded notation, rounding, decimal concepts, 
fractions, ratios, basic computation and comparison of numbers. The Number 
test items are similar to: 

Which of the following gives 749 rounded to the nearest hundred? 

A 700 B 750 C 740 D 800 
(Similar to ACER, 1980a, Unit I, p. 2, q. 3) 

The number that is 2 less than 4000 is 

(Similar to Brown, Hart & Kucheman, 1984, p. 6) 

What fraction of the figure is shaded? 

A 0.4 B 0.3 

C 0.7 D 0.6 
(Similar to ACER, 1970a, p. 2, q. 7) 

The Operations 3/4 test consists of 25 items, 20 of which came from the 
ACER MPS, and the other five were from the Alberta Education Gr^de 3 
Mathematics Achievement Test. Operations 5/6 consists of 33 items, 30 of 
which were drawn from the ACER MPS and the balance from the 1983 Alberta 
Education Grade 6 Mathematics Achievement Test. The ACER items call for the 
student to demonstrate operational understanding of commutative, associative, 
distributive, inverse, and identity properties with numbers that are either 
single-digit or multi-digit. The only modification of the ACER Operations 
items for the purposes of the ACLIC study was the elimination of signed nunber 
distractors as these are outside of the Alberta Curriculum until Grade 6. The 
ACER Operations items are similar in format to: 




2 + 5 = 5 + [] 
358 X 1 = [] 
(H + 7) + 3 = [] + (7 + 3) 
(Similar to ACER, 1977, pp. 1, 3, qs. 1, 24, 8) 
The Measurement 3/4 test contained 28 items, all of which were drawn from 
the ACER MPS and AM series. The Measurement 5/6 test contained 35 item3, 30 
from the ACER MPS and AM series and 5 from the Alberta Education Grade 6 
Mathematics Achievement Test. These tests call on students to demonstrate: 
conservation of length, area, volume, and mass; iteration of units of 
measurement; perceptions of time; the numerical representation of measurement; 
and the concept of rate. Sample items are: 




"No clay was added and no clay was taken away. The long shape has 




(ACER, 1970b, p. 2, q. 2) 
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"In the diagram the shaded triangle represents a unit which can be 
used to measure area. 
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Which one of the following gives the number of such units in the 
hexagon? 

A 5 B 6 C 8 D 12 " 
(ACER, 1979, Unit II, p. 10, q. 18) 

The Space 3/4 (Geometry and Graphing) test contains 30 items, 25 from the 
ACER MPS and 5 from the 1983 Alberta Education Grade 3 Mathematics Achievement 
Test. Space 5/6 contained 36 items, 32 from the ACER MPS and 4 from the 1983 
Alberta Education Grade 6 Achievement Test. Tne Space tests call on students 
to demonstrate an understanding of order, reversibility, transformations, 
3-dimensional visualization, location of objects in a coordinate plane, 
ability to handle multiple attributes of shapes, and knowledge of symmetry. 
The following items illustrate the types of questions included in the Space 
tests: 

"These two foot prints were seen on the sand. 




They were made by 

A a left foot and a right foot B two left feet C two right 
feet " 

(ACER, 1978, Unit I, p. 4, q. 2) 
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"If the bead labelled V was threaded first, what was the order for 
threading the rest of the beads? 



A W, M, 0, P, Y, G, B, R 
C 0, M, W, P, Y, G, B, R 



B W, M, 0, P, B, G, Y, R 
D 0, M, W, P, B, G, Y, R " 




(Acer, 1978, Unit I, p. 4, q. 3) 



"Which of the following shapes can be folded on the dotted lines to 
from a cube? 



i — n r 

i t i 
j i L 



(ACfR, 1978, Unit I, p. 4, q. 4) 
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"This is the reflection of a clock in a mirror. It appears to be 
reading 'half past two. 1 
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The time shown by the actual clock would be 

A 2:30 B 6:12 C 9:30 D 10:30 " 
(ACER, 1978, Unit I, p. 9, q. 28) 
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Cognitive Demand Assessment: Curriculum Objectives 
The ACLIC Team assessed the cognitive demand levels of all of the 
objectives stated in the 1982 Alberta Education Elementary Mathematics 
Curriculum Guide using the Cognitive Levels definitions stated previously and 
the Cognitive Demand Level Criteria summarized in Appendix 2. In Appendix 5 
each of the curriculum objectives is listed along with one or more cognitive 
demand level ratings, depending on the number of subparts implied in the 
statement of the objective . 

Cognitive Demand Assessment: Textbooks 
The Cognitive Levels definitions and the Cognitive Demand Level Criteria 
(See Appendix 2.) were used to rate the cognitive demand levels of the 
explanations, problems, and exercises in two of the four authorized elementary 
school mathematics textbooks at each of the six grade levels (62 306 items 
were assessed altogether) ♦ Only those textbook items included in the Alberta 
curriculum were assessed. At each grade level at least one of the texts 
assessed was from one of the two series most often chosen by Alberta schools. 
Cognitive Demand Assessment: Classroom Observations 
Assessment of the cognitive demands made in regular classroom lessons was 
the only item in the ACLIC proposal that was greeted with strong reservations 
when the idea was discussed with teachers. For a time, the Project Team 
considered dropping this part of the planned cognitive demand assessments, but 
decided to proceed when encouraged to do so by the Steering Committee and when 
the Project Director expressed confidence that thirty or more elementary 
school teachers from the Calgary Board of Education would be willing to 
volunteer to have one of their classes observed for the purposes of the 
project. The response to the circulated request for teachers was gratifying, 
indeed, and a total of thirty-six classroom observations were arranged* 
Thirty-four Calgary Board of Education classes and two Calgary Catholic Board 
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classes were observed. With the exception of Measurement in Grades 4 and 6, 
classroom lessons were observed at each grade level in every topic strand. Of 
the four ki^is of cognitive demand assessment conducted in the ACLIC Project, 
only the classroom observations cannot be claimed to be representative of 
teachers across the province. The teachers observed were self-selected 
through the very process of volunteering, and they came only from two large 
urban school systems. Given the circumstances under which the classroom 
observations were arranged, the lessons observed would very likely represent 
better than average approaches to the teaching of elementary school 
mathemstics in the province of Alberta. 

Given the considerable pressures on the Project Team to complete the 
other cognitive assessments, and in the interests of consistent observations, 
it was decided to ask Richard Holmes to be the ACLIC Classroom Observer. 
Although the classroom observations had to start before the cognitive demand 
assessments of the Elementary Mathematics Curriculum Objectives could be 
completed, with the attendant refinement of the ACLIC cognitive demand 
criteria, the Project Team had numerous detailed discussions that included the 
Classroom Observer and that treated in detail the general descriptions of the 
cognitive response levels (see Definitions of Terms ), specific mathematics 
topic examples from the interviews and paper-and-pencil tests, and trial 
cognitive assessments of videotaped lessons. The emphasis was on assessing 
the cognitive level of the expectations of students in the lessons observed. 
The discussions sharpened the observation procedures and critera, leading to 
an observation form that was designed to facilitate concise minute-by-minute 
observations throughout a whole class period. A copy of the Observation 
Record Sheet is included in Appendix 3. 

In the actual classroom observations, paced by minute-interval beeps from 
a slide-rule computer, the Classroom Observer made cognitive level ratings 
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every minute of the major emphases in the teacher's presentations and in the 
activities being engaged in by the majority of the students- The Observer 
followed tr.e teacher when there were three or more groups working in the class 
or when at least half of the class was with the teacher. Copies of the 
worksheets used in each class were collected for subsequent cognitive 
assessment and a note was made of any textbook or workbook pages assigned to 
be completed in class. When centres were used, the type of activity and 
materials at each centre were recorded for later assessment. Split grades 
were treated as two grades with records bein^ made of the separate lessons, 
assignments, and other materials. 

With one or two exceptions (in which a "special" lesson was apparently or 
allegedly presented), the lessons observed were those normally taught by the 
teacher as part of the regular program. 

Cognitive Demand Assessment: Achievanent Tests 

Using the Cognitive Levels definitions and the Cognitive Demand Level 
Criteria (See Appendix 2), cognitive demand assessments were made of all 95 of 
the items in Parts A and B of the 1982 Grade 3 and 1983 Grade 6 Alberta 
Mathematics Achievement Tests. The purely computational items contained in 
the other parts of the Achievement Tests were not included. 

Analysis of Data 

The data for the first and second research questions investigated in the 
ACLIC Project were collected from student Interview and Paper-and-pencil 
cognitive response assessments and from cognitive demand assessments of the 
curriculum objectives, textbook materials, classroom observations, and Alberta 
Education achievement test items. The findings were tabulated and presented 
in the form of of percentage distributions of responses or demands found at 
the Preoperational, Early Concrete Operational, Late Concrete Operational, 
Early Formal Operational, or Formal Operational levels. 
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The third research question investigated by the ACLIC Project askeo: 
"How well ao the distributions of curricular cognitive demands fit the 
distributers :»f student cognitive responses at each grade level in each 
mathematics topic strar.d?" In the process of choosing an appropriate 
statistical analysis to provide answers for this question, an assumption was 
maoe that the observed distributions of student cognitive responses should be 
reflected, at least approximately, by the distributions of cognitive demands 
found in the curricular material the students are expected to learn. In one 
sense, Research Question 3 asks how well the curricular materials anticipate 
the cognitive levels at which the intended students normally operate, given a 
particular mathematics learning context. If, for example, many students arc 
still operating at a Preoperational level in a given topic but they are 
expected to learn only from materials that require at least Concrete 
Operational thinking, a cognitive mismatch between students and curriculum is 
apparent. Similarly, a mismatch can occur when there is little or no material 
of suitable sophistication to challenge Early Formal or Formal Operational 
thinkers. To answer Research Question 3, two-sample Kolmogorov-Smirnov tests 
(Siegel, 1956, 127-136) were used to determine whether or not there were 
significant differences between the ordered distributions of student responses 
and the ordered distributions of the relevant curric ular demands at each grade 
level and in each topic strand. The Kolmogorov-Smirnov procedure assesses the 
absolute differences between the cunulative proportions produced by the two 
frequency distributions being compared. It tests whether two independent 
samples have been drawn from populations with the same distribution (Siegel, 
1956, 127). The maximum difference observed between two cunulative proportion 
distributions, the Kolmogorov-Smirnov !, D, !I can be compared with a critical 
"D," for which the sampling distribution is known under the hypothesis of no 
significant differences between the distributions. For a given sample size, 
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probabilities car. be associated with the occurence of a difference as large as 
the observed K-S lf D." Each Curricular Cognitive Demand frequency distribution 
was compared with that of the observed Pupil Cognitive Responses after the 
Demand frequencies had been scaled so that their totals matched the number of 
students assessed by interview or by paper-and-pencil test. The Null 
Hypothesis of no significant difference between two distributions was accepted 
if the probability of observing the calculated K-S D was greater than 0.05. 
For N=60 and p=0.05, the critical two-sample K-S D value is 0,248. When the 
observed K-S D exceeded this value, the null hypothesis was rejected, 
indicating that there was a significant difference between the two 
distributions- While the K-S D statistic itself is not affected by the sample 
size, N, the critical value of "D" is. For example, for N=100 and p=0.05, the 
critical two-sample K-S D is 0.192 (as compared with 0.248 when N=60). 
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FINDINGS OF THE STUDY 
The presentation of the findings of the study is organized in the 
following way. First, the cognitive levels of student responses are reported 
by strand and by grade . Next, the levels of cognitive demands of objectives, 
textbooks, classroom presentations, and provincial achievement tests are 
detailed. Finally demands are compared with responses by strand and by grade. 

Cognitive Levels of Students ' Responses . 
Cognitive levels of students' responses were observed in interviews 
(Grades 1 to 3) and in paper-and-pencil tests (Grades 3 to 6). Since these 
modes of assessment are so different, an important question is whether the two 
methods are consistent and yeild the same or similar distributions of students 
tc cognitve response levels. At the Grade 3 level where some students who 
were interviewed also took paper-and-pencil tests, this question is answered 
in the affirmative by means of a statistical test presented in Figures 21, 23, 
25 , and 27, and described in a later section. 
Numeration . 

The findings regarding the cognitive levels of students' responses in the 
Numeration strand are presented in Figure 1. 

The percentage of Preoperational responses ranged from a high of 22% in 
Grade 1 to a low of 1% in Grade 4. Interestingly there were more 
Preoperational responses in Grades 5 and 6 (16% and 14%, respectively) than in 
the two preceeding grades. One reason for this apparent anomoly may be that 
the tasks and test items differ for the different grades. The test for Grades 
5 and 6 placed a heavy emphasis on fractions and decimals, topics at a high 
cognitive level. Students who performed Preoperational^ in this area might 
not have done so in the context of whole numbers which received greater 
emphasis in the earlier grades. 

It is interesting to note that at each grade throe-quarters or more of 
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Figure 1: Cognitive Levels of Pupils 1 Responses, Numeratic i 
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the responses were at concrete operational levels (Early Concrete and Late 

Concrete combined). 

The pe r rentage of Early Formal Operational responses increased from 0 in 
Grade 1 and 2% in Grade 2 to about 12% in Grades 3, 4, and 6. Again, the fact 
that the percentage does not i ise steadily is probably due to differences in 
the mathematical contexts in which the assessments wore made. 
Operations . 

Findings with respect to cognitive levels of students' responses in 
Operations are presented in Figure 2. 

The percentage of Preoperational responses decreased steadily from 29% in 
Grade 1 and 13% in Grade 2 to about 4% in Grade 3 and nil thereafter. As in 
Numeration, a substantial majority of responses were Concrete Operational in 
Grades 1 to 5. But by Grade 6 the percentage at these levels was found to be 
only 34%, the Early Formal Operational and Formal Operational responses having 
risen to 66%. 
Measurement . 

The findings regarding the cognitive levels of students 1 responses in 
Measurement are presented in Figure 3. 

In this strand about two-thirds of the responses of Grade 1 children and 
about half of the responses of Grade 2 children were Preoperational. The 
fraction drops to about a third in Grade 3 and even less in Grades 4, 5, and 
6. Concrete Operational responses are in the majority from Grade 2 onwarri. 
The percentage of Early Formal Operational and Formal Operational responses 
increases from 0 in Grade 1 and 2% in Grade 2 to 20% in Grade 6. 
Geometry and Graphing . 

The findings concerning the cognitive levels of students 1 reponses in 
Geometry and Graphing are shown in Figure 4. 

The percentage of responses that were Preoperational declined steadily 
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Figure 2: Cognitive Levels of Pupils 1 Responses, Operations 
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Figure 3* Cognitive Levels of Pupils 1 Responses. Measurement 
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Figure 4: Cognitive Levels of Pupils 1 Responses, Geometry & Graphing 
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from 371 in Grade 1 to 4% in Grade 6, while the percentage of Formal 
Operational responses rose fairly evenly from 0 in Grade 1 and 2% in Grade 2 
to 23% in Grade 5. About two-thirds or more of the responses were Concrete 
Operational in all six Grades. 

An interesting observation arising from the analysis of the pupils' 
responses to the Classification-Inclusion tasks was that the additional 
two-dimensional task assigned to the Grade 2 and 3 children produced more 
correct responses than did the comparable task with the solids. This raises a 
question about which is more demanding cognitively in the concrete mode, 
working with three-dimensional or two-dimensional shapes. 
Cognitive Levels of Students 1 Responses by Grades . 

Figures 5 and 6 show the levels of students 1 responses for each grade. 
Generally the pattern which emerges is that the percentage of Preoperational 
responses decreases and the percentage of Early Formal and Formal Operational 
responses increases from Grade 1 to 6. At each grade level the clear majority 
of responses is at the Concrete Operational level (Early Concrete and Late 
Concrete combined). 

Generalizing across grades, the Measurement strand stands out as the one 
with the largest proportions of Preoperational responses and the smallest 
proportions of Early Formal Operational responses. On the other hand, the 
Operations strand appears to have the greatest percentage? of higher-level 
responses. 

Curricular Cognitive Demands. 
Co gnitive Demands of Curriculum Objectives . 

A detailed listing of the Grade 1 to 6 curriculum objectives along with 
their assessed cognitive demand levels is included in Appendix 5. In the 
sections which follow the curriculum objective demand level findings are 
summarized by strand. 
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Figure 5 

Grade 1 Pupil Response Levels by Strands 
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Grade 2 Pupil Response Levels by Strands 
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Grade 3 Pupil Response Levels by Strands 



Numeration 
Operations 
Measurement 



Geometry & 
Graphing 



ERIC 



To- 
rn 



To~ 

33 
% 

TO - 
26 
* 



A2 



Tc" 

37 



TT 
AO 



"EC 

37 
i 



73 56 



TT 

37 



A9 



ur 

21 

% 

TT 
27 
% 



~W 

12 



TT 
9 
% 

TFT 



Figure 6 

Grade 4 Pupil Response Levels by Strands 
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Grade 5 Pupil Response Levels by Strands 
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Grade 6 Pupil Response Levels by Strands 
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Numeration . Figure 7 shows the cognitive demand levels of objectives 
in the Numeration strand. Demands at the Preoperational level are found only 
in Grade 1 Early Concrete Operational demands are included in each 

grade, steadily decreasing from 66% in Grade 1 to 14% in Grade 6. The 
percentage of Late Concrete Operational demands increases from 17% in Grade 1 
to 55% in Grades 3 and 4, but decreases thereafter. Early Formal Operational 
demands are not found before Grade 4, but increase from 27% in Grade 4 to 54% 
in Grade 5 and 50% in Grade 6. 

O perations . Cognitive demand levels of Operations objectives are 
shown in Figure 8. There are no objectives with Preoperational demand levels 
in this strand. The proportion of Early Concrete Operational demands 
decreases from more than two-thirds in Grades 1 and 2 to about a quarter in 
Grades 4, 5, and 6. As in the Numeration strand, the percentage of objectives 
at the Late Concrete Operational level increases then declines, from about 30% 
in Grades 1 and 2, to about 50% in Grades 3 and 4, to about 20% in Grndes 5 
and 6. Early Formal Operational demands first appear in Grade 3 (8%) and rise 
to nearly 50% in Grades 5 and 6. In Grade 6, 8% of the demands are at the 
Formal Operational l*vel. 

Measurement . Figure 9 displays the cognitive demand levels of 
Measurement objectives. Preoperational demands are found only ir: Grades 1 and 
2 (26% and 13%, respectively). Objectives with demands at the Early Concrete 
Operational level are prominent in Grades 1 and 2 (42% and 29%, respectively), 
but constitute about 10% or less of the objectives in later grades. The 
percentage of Late Concrete Operational demands rises then declines as in the 
previous two strands. Early Formal Operational demands first appear in Grade 
4 (7%), increasing to 26% in Grade 5 and 60% in Grade 6. 

Geometry & Graphing . The cognitive demand levels of objectives in the 
Geometry and Graphing strands are displayed in Figure 10. Preoperational 
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Figure 7: Cognitive Demands of Numeration Objectives 
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Figure 8: Cognitive Demands of Operations Objectives 
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Figure 9: Cognitive Demanas of Measurement Objectives 
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Figure 10: Cognitive Demands of Geometry & Graphing Objectives 
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demands occur only in Grade 1 (33%). The percentage of Early Concrete 
Operational demands declines steadily from 67% in Grade 1 to 16% in Grade 6, 
while the percentage of Late Concrete Operational demands rise5> from 0 in 
Grade 1 and ?9% in Grade 2 to 53% in Grade 6. Early Formal Operational 
demands first appear in Grade 3 (17%) and increase steadily to 31% in Grade 6. 
Cognitive Demands of Prescribed Textbooks * 

As described previously, the Cognitive Levels definitions and the 
Cognitive Demand Level Criteria (see Appendix 5) were used to assess the 
cognitive demand levels of every curriculum-related explanation, problem, >nd 
exercise in two prescribed textbooks at each grade level. 

Numeration . Figure 11 presents the levels of cognitive demands of 
Numeration items in prescribed textbooks. Demands at the Preoperational level 
occurred in Grade 1 (22%), but rarely (3% or less) in later grades. The 
percentage of textbook demands at the Early Concrete Operational level 
declines from 68% in Grade 1 to only 1% in Grade 6. The percentage of Late 
Concrete Operational demands rises from 10% in Grade 1 to a maximun of 55% in 
Grade 4, then falls to 15% by Grade 6. Early Formal Operational demands begin 
in Grade 4 at 23% and predominate by Grade 6, where they represent 84% of the 
items. 

O perations . Cognitive demand levels of Operations items in textbooks 
are shown in Figure 12. There are no textbook items with Preoperational 
demand levels in this strand. The Early Concrete Operational demands range 
from 91% in Grade ■ to U% in Grade 6. The percentage of Late Concrete 
Operational derc 'ncreases from 9% in Grade 1 to a maximun of 56% in Gra* 
4 then decreases tj 31% 5n Grade 6. Early Formal Operational demands first 
appear in Grade 3 (4%) and reach a level of 57% in Grade 6. A further 9% of 
the Grade 6 demands are at the Formal Operational level, 

Measurement * Figure 13 shows the cognitive demand levels of 
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Figure 1 1 : 



Cognitive Demands of Textbooks, Numeration 
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Figure 12: Cognitive Demands of Textbooks, Operations 
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Measurement items in textbooks. The percentage of Preoperational demands was 
1% in Grade 1, but negligible in later grades. Early Concrete Operational 
demands declined from 8U in Grade 1 to 10% in Grade 6. Late Concrete 
Operational demands increased from 12J in Grade 1 to a peak of 75% in Grade 3, 
then declined to 29J in Grade 5 and 41 J in Grade 6. The percentage of Early 
Formal Operational demands is 0 in Grades 1 to 3, 24t in Grade 4, 63% in Grade 
5, and *»9t in Grade 6. 

G eometry & Graphing . The cognitive demand levels of textbook items on 
Geometry and Graphing are presented in Figure 14. The percentage of 
Preoperational demands was in Grade 1 and 29J in Gfade 2, but 
insignificant in the other grades. About half or slightly more of the demands 
at each grade level were at the Early Concrete Operational level. The 
percentage of textbook demands at the Late Concrete Operational level was 0 in 
Grade 1 and about 20t in all the other grades except Grade 5 where it was 451. 
Early Formal Operational demands increased from 0 in Grades 1 and 2 and H% in 
Grade 3 to a maximum of 22t in Grade 6. 
Cognitive Demands of Classroom Observations . 

A detailed tabulation of the classroom observations showing the numbers 
of minutes obrerved at each cognitive demand level for each grade and strand 
is included in Appendix 6. In the sections which follow, these findings are 
summarized by strand. 

Numeration . A summary of the levels of cognitive demands of classroom 
observations in Numeration is presented in Figure 15. No Preoperational 
demands were observed, but Early Concrete Operational demands were found in 
Grade 1 (97?) and Grade 2 (38*). Late Concrete Operational demands comprised 
about half of the sample of demands in Grades 2, 3 f and 5 and all of the small 
sample (8 minutes) of Numeration demands in Grade 3. The percentage of Early 
Formal Operational demands was insignificant in Grades 1 to 3 but rose 
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Figure 13: Cognitive Demands of Textbook^ Measurement 
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Figure 14: Cognitive Demands of Textbooks, Geometry & Graphing 
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steadily from 43% in Grade « to 91* in Grade 6. 

Operations . Figure 16 presents a summary of v,he levels of cognitive 
demand in Operations observed in classrooms. No demands at the Preoperational 
level were observed. Early Concrete Operational demands ranged from 97% in 
Grade 1 to 2% in Grao* 5 and none in Grade 6. Late Concrete Operational 
demands rose from 23% in Grade 2 to a maximim of ^3% in Grade 3 and declined 
to 28% in Grade 5 and 0 in Grar'.' 6. Early Formal Operational demands first 
appeared in Grade 2 (17%) and peaked at 70% in Grade 5. The demands in Grade 
6 were 22% Early Concrete Operational with the remaining 78% Formal 
Operational. 

Measurement . Figure 17 summarizes the cognitive demands of classroom 
observations in Measurement. Unfortunately, no classroom observations were 
made of measurement activities in Grades 4 and 6. In Grade 1 76% of the 
demands were at the Early Concrete Operational level, only 1% were Late 
Concrete Operational, and 22% were Early Formal Operational. In Grades 2, 3, 
and 5 about three-quarters or more of the demands were Late Concrete 
Operational and the rest were Early Formal Operational. 

Geometry & Graphing . The cognitive demands of classroom observations 
involving Geometry and Graphing are presented in Figure 18. The situation in 
Grades 1 to 3 is notable for its lack of Late Concrete Operational demands 
(6% in Grade 3 only). In Grades 1 and 3 about two-thirds of the demands were 
Early Concrete Operational and one-third were Early Formal Operational, while 
in Grade 2 these fractions were reversed. In Grade M the demands were split 
almost evenly between the Early Concrete Operational and Late Concrete 
Operational categories. Grade 5 has some Early Concrete Operational, about 
half Late Concrete Operational, and some Early Formal Operational demands. In 
Grade 6 the demands were almost entirely Late Concrete Operational, except for 
a few (11%) Early Formal Operational. 
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Figure 15: Cognitive Demands of Classroom Observations, Numeration 
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Figure 16: Cognitive Demands of Classroom Observations, Operations 
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Figure 17: Cognitive Demands of Classrooms Observed, Measurement 
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Figure 18: Cognitive Demands of Classrooms Observed, Geometry & Graphing 
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Cognitive Demands of Provincial Achievement Tests . 

Appendix 7 contains a detailed listing of the topics and cognitive 
aemanas of items in Parts A and B of the Alberta Mathematics Achievement Tests 
for Grade 3 (June 1982) and Grade 6 (June 1983) • The remaining Parts of these 
tests which contain computational exercises on?.y were not assessed. The 
sections which follow summarize the findings. 

Gj^ ' 3. Figure 21 shows the distributions of the cognitive demands 
of the 50 items of the Grade 3 Achievement Test by curriculum strand and for 
the test as a whole. Except for one item in Geometry and Graphing which had a 
demand at the Early Formal Operational level, all the item demands were either 
Early Concrete Operational or Late Concrete Operational. For the test as a 
whole the demands were about one-third Early and two-thirds Late Concrete 
Operational. The Numeration strand and Geometry and Graphing strand had 
demands about evenly divided between Early and Late Concrete Operational, 
while the Operations and Measurement strands were more heavily weighted with 
Late Concrete Operational demands (86% and 83%, respectively). 

Grade (3. The cognitive demands of the 45 items on the Grade 6 
Achievement Test are shown in Figure 22. One item in Numeration and one in 
Geometry had demands at the Early Concrete Operational level. Late Concrete 
Operational iters made up 295 of the test as a whole, those being 11% of the 
Measurement items, 27% of the items in Numeration and in Operations, and 50% 
of those in Geometry and Graphing. Three-fifths of the items had demand? at 
the Early Formal Operational level; this comprised about 90% of the 
Measurement items and about halt of the items \n the other strands. Three 
items in Operations (20% of the strand, 11 of the whole test) were at the 
Formal Operational level. 
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Figure 19: Cognitive Demands of Grade 3 Provincial Achievement Test 
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Figure 20: Cognitive Demands of Grade 6 Provincial Achievement Test 
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Cognitive Demands Compared with Student Cognitive Response Levels 

Numeration 

Numeration, Grades 1 to 3 

The findings from the comparisons between curricular demand and pupil 
response distributions in Numeration strand topics in Division One are 
summarized in Figure 21. 

At the Grade 1 level, the distribution of Numeration curriculum 
objectives matched the distribution of pupil responses reasonably well. 
However, the Grade 1 textbooks and classrooms proved to be short of Late 
Concrete Operational material (10% and 3%, respectively, whereas 37% of the 
Grade 1 students responded at this level in Numeration topics) . Even though 
there were no Preoperational demands observed in the classroom (compared with 
22% of the student responses at this level) this difference, alone, was not 
large enough to cause rejection of the Null Hypothesis. 

The Grade 2 Numeration findings showed a mismatch only between textbook 
demands and pupil responses. While 59% of the Grade 2 students responded at 
the Late Concrete or Early Formal levels, only 28% of the textbook material 
made comparable demands. The overabundance of Early Concrete demands, as 
compared with student responses, would also have been sufficient to cause the 
r.ull hypothesis to be rejected. 

As shown in Figure 21, two assessments of pupil cognitive response level 
were used in Grade 3. Paper-and-pencil cognitive assessment tests covering 
"Number" concepts were administered to 115 Grade 3 pupils. Of these, 60 had 
previously been interviewed using number concept and numeration tasks. The 
distributions of cognitive ratings from the interview and paper-and-pencil 
assessments were not significantly different, as indicated by a K-S D of 0.117 
which could occur by chance in more than 20% of frequency distributions drawn 
from the same population. The distributions of demands by the Grade 3 
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Figure 21 

Curricular Demand and Pupil Response Contrasts: Numeration, Grades 1 to 3 
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•Kolmogorov-Smirnov Goodness of Fit Test: Each Curricular Cognitive Demand 
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considered not significantly different if the probability of observing the 
calculated K-S D was greater than 0.05 (with N s number of pupils). 
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Numeration curricular objectives, textbooks, and achievement test items all 
matched reasonably well with the student cognitive response distributions, 
whether assessed by interview or paper-and-pencil test. As for classroom 
demands in Grade 3, only 8 minutes were observed in which Numeration topics 
were treated. This lesson segment contained only Late Concrete demands, which 
resulted in a mismatch because of the lack of provision for those students 
responding at the Preoperational and Early Concrete levels. The brevity of 
the classroom observation should be taken into account in the interpretation 
of this particular finding. 
Numeration, Grades 4 to 6 

Figure 22 summarizes the Numeration findings for Grades 4 to 6, The 
cognitive response distributions are from paper-and-pencil assessments of 
nimber and nimeration concepts and understandings. 

The Grade *l findings are much like those of Grade 3, with a mismatch only 
between the classroom demands and the pupil responses. Here the observation 
time is much longer (72 minutes) , but the mismatch is due to an excess of 
Early Formal demands as compared with pupils responses at this level (43% 
versus 13%) , which implies a shortage of demands below the Early Concrete 
level . 

The Grade 5 and 6 findings show mismatches between demands and pupil 
responses for every comparison. In every case the large percentage of Early 
Formal demands as compared with the small percentage of responses at that 
level (3% and 12%) is enough to cause rejection of the null hypothesis. This 
finding can also be viewed as indicating that there are insufficient demands 
at or below the Late Concrete level. In the case of Grade 5 textbooks, it in 
the discrepancy between the demands ^t the lowest level rated, Early Concrete 
(9%), and the combined Preoperational and Early Concrete responses (58$) that 
is reflected in the observed K-S D. 
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Figure 22 

Curricular Demand and Pupil Response Contrasts: Numeration, Grades 4 to 6 
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distributions were considered not significantly different if the probability 
of observing the calculated K-S D was greater than 0.05 (N = number of 
pupils) . 



BEST COPY AVAILABLE 



73 90 



Overall, there is a reasonable match between curriculum objective demands 
and pupil responses in the Numeration topics from Grade 1 through Grade 4. A 
reasonable match between textbook demands and pupil responses was found in 
Grades 3 and 4 but not in the earlier or later grades. All of the demand 
distributions in Grades 5 and 6 are marked by a significant excess at the 
Early Formal level (with a corresponding shortfall of material posing demand, 
at or below the Late Concrete level). 

Operations 

Operations, Grades 1 to 3 

Figure 23 summarizes the comparisons made between curricular demands and 
pupil responses in the Operations strand from Grade 1 to Grade 3- 

Each of the demand distributions in Grades 1 and 2 were found to differ 
significantly from the relevant pupil response distributions. In Grade 1, 29% 
of the students were responding Preoperationally but none of the demands 
addressed that level, resulting in a mismatch. In Grade 2 the mismatches 
resulted from a lack of material suited to the 65% responding at the Late 
Concrete level coupled with the complementary overabundance of material at or 
below the Early Concrete. The demands of the curriculum objectives, the 
textbooks, and the classroom in Grade 3 were distributed in a manner not 
significantly different from the pupil response demands. However, the Grade 
3 Achievement Test items dealing with Operations were largely at the Late 
Concrete demand level (83% as compared with 53% and 59% of the pupil responses 
rated at the Late Concrete and Early Formal operational levels, combined), 
which implies insufficient items at or below the Early Concrete level. 
Operations, Grades 4 to 6 

A summary of the demand/response contrasts observed in the Operations 
strand from Grade 4 to 6 is presented in Figure 24. 

Reasonable matches between the pupil responses and the demands of the 
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Figure 23 

Curricular Derand and Pupil Response Contrasts: Operations, Grades 1 to 3 



9 

ERIC 



Gr.1 Interview 
Ratings 

60 pupils 
Gr.1 Curric. 
Objectives 

6 items 
Gr.1 Textbooks 
(Operations) 

3077 items 
6r . 1 Classroom 
Observations 

36 minutes 

Gr.2 Interview 
Ratings 

60 pupils 
C~.2 Curric. 
Objectives 

9 items 
Gr.2 Textbooks 
(Operations) 

4656 items 
Gr.2 Classroom 
Observations 

77 minutes 

Gr.3 Interview 
Ratings 

60 pu pils r < 
Paperi Pencil 
Tests (ACER) 

94 pupils 
Gr.3 Curric. 
Objectives 

26 items 
Gr.? Textbooks 
(Operations) 

6857 items 
(Sr .3 Classroom 
Observations 

124 minutes 
Achievement 
Test (Gr.3) 

18 items 



TO" 
29 
t 



IF 

42 
% 



To~ 

13 
X 



17 
% 



TUT 
67 
% 



91 
I 



97 
I 



IT 

22 
% 



78 
% 



TT 
60 
% 



TT 

90 



38 
% 



42 
I 



"EC" 

42 



51 
% 



54 



29 
% 

33 



TT 

65 
t 



23 
% 



TT 

46 



TT 
49 
% 



TT 

50 



TT 
83 
% 



TT 
43 
% 



42 



TT 
9 
I 



c 



22 



10 

m 

7> 



17 



W 

13 



TT 

8 
% 



K-S D* 
Probability 
Decision 

D=0 . 290 

p=0.014 

Reject 
' D=5 .296" 

p=0.014 

Reject 

b=67596 

P=0.014 
Reject 

K-S D* 

Probability 
Decision 
D=0.430 
p<0.001 
Reject 



D=fl.552 

p<0.001 
Reject 

b=o\249 
p=0.049 

Reject 

Inter- K-S D* 
view Prob. 

Dec'n 

Paper 0.086 
K-3 D* >0.200 
Prob. Acc. 

6.651 6.652 

>0.200 >0.200 
Acc . Acc . 

6.125 6.665 

XI.200 >0.200 
Acc . Acc . 

0.093 6.050 

XI.200 >0.200 
A cc . A cc . 

6.2H8 6.365 

0.006 <0.007 
Rej. Rej. 



"PO-Preoperational; E(J-Early Concrete; LC-Late Concrete" 
EF-Early Formal; F-Formal 
*Kolmogcrov-Smirnov Goodness of Fit Test: Each Curricular Cognitive Demand 
frequency distribution was compared with that of the corresponding Pupil Cognitive 
Responses to Interview or Paper-and-Pencil assessments. Two distributions were 
considered not significantly different if the probability of observing the 
calculated K-S D was greater than 0.05 (with N = number of pupils). 



BEST COPY AVAILABLE 



75 



92 



Figure 24 



Curricular Demand and Pupil Response Contrasts: Operations, Grades 4 to 6 









It 


EF 




Rati n c?<> 






50 


30 


n uuduiiiuy 


100 pupils 


% 




% 




% 


Decision 


Gr.U Curric. 


EC " 


i 




LC 




1 EF 1 


"D=0.683 


Objectives 


26 






52 




22 


p>0.200 


23 items 


% 






% 




% 


Accept 


(ir.U Textbooks 


EC 






LC 




EF 1 


D=0.fef 


(Operations) 


29 






56 




15 


p=0. 180 


9128 items 








% 




% 


Accept 


(Jr. 4 Classroom 




EC 




LC 




EF " 


t)=0V265' 


Observations 




47 




30 




23 


p=0.002 


86 minutes 




% 




% 




% 


Reject 



Gr.5 P&P Test 
Ratings 

9^ pupils 
Gr.5 Curric. 
Objectives 

25 items 
6r.5 textbooks 
(Operations) 

6385 items 
Gr.5 Classroom 
Observations 

131 minutes 



Gr.6 P&P Test 


r 


LC 






eF 




"F 


K-S D* 


Ratings 


c 


31 






57 




9 


Probability 


92 pupils 


3 


% 






% 




% 


Decision 


Gr.6 Curric. 




EC 


LC 


r 


" EF ■ 




F 




Objectives 




28 


20 




44 




8 


p=0.008 


25 items 




% 


% 




% 




% 


Reject 


Or. 6 Textbooks 


E 


LC 






EF 




F 


D=0.018 


(Operations) 


c 


31 






57 




8 


p>0.200 


6402 items 


14 


% 






% 




% 


Accept 


Gr\6 Classroom 




EF 






F 








Observations 




22 






78 






p<0.001 


54 minutes 




% 






% 






Reject 


Achievement 




LC ' 




EF 




F 




6=5.113 


Test (Gr.6) 




27 




53 




20 


p>0.200 


15 items 




% 




% 




% 


Accept 


PO- 


Preoperationa 


1; EC-Early Concrete; Lc-Late Concrete; 



EF-Early Formal; F-Fonnal 
•Kolmogorov-Smirnov Goodness of Fit Test: Each Curricular Cognitive Demand 
frequency distribution was compared with that of the corresponding Pupil 
Cognitive Responses to Interview or Paper-and-Pencil assessments. Two 
distributions were considered not significantly different if the probability 
of observing the calculated K-S D was greater than 0.05 (with N = number of 
pupils). 
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curriculum objectives and of the textbooks were found in Grades 4 and 5. The 
same was found with the textbooks in Grade 6. This was not the case for the 
Grade 6 curriculum objectives nor for the classroom observations in all three 
Division Two grades . The Grade 6 curriculum objectives were 28% Early 
Concrete Operational but only 3% of the pupils responses were at this level. 
The largest discrepancies between pupil responses and classroom demands were 
as follows: Grade 4, 47% Early Concrete demand contrasted with 20% response 
at that level; Grade 5, 70% Early Formal demand versus 37% combined Early 
Formal and Formal pupil responses; and Grade 6, 78% Formal demands compared 
v/ith only 9% of the pupil responses classified at that level. The 
distribution of the Grade 6 achievement test items dealing with operations was 
not significantly different from that of the pupil responses. 

Measurement 

Measurement, Grades 1 to 3 

The summary of the demand/response contrasts presented in Figure 25 shows 
that all of the demand distributions were significantly different from the 
pupil response distributions. 

In Grades 1 and 2, the mismatches between pupil responses and both the 
demands of the curriculm objectives and of the classroom can be attributed to 
the lack of provision for students operating Preoperationally in measurement 
contexts (6H% and 49% of the Grade 1 and 2 responses, respectively, in 
contrast with only 1% to 26% of the demands occurring at the Preopertional 
level). This was also the case with the Grade 1 classroom observations (no 
Preoperational demands as compared with 6M% of the pupil responses occurring 
at this level). An even greater discrepancy was found at the Grade 2 level 
where classroom demands were not less than Late Concrete but where 76% of the 
student responses were. 

As for Measurement in Grade 3, the pupil response ratings from the 
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Figure 25 

Curricular Demand and Pupil Response Contrasts: Measurement, Grades 1 to 3 



9 

ERIC 

hnnnninrnrmnMa 



Gr.1 Interview 
Ratings 

60 pupils 
Gr . 1 Curric. 
Objectives 

19 items 
Gr . 1 Textbooks 
(Measurement) 

297 items 
Gr . 1 Classroom 
Observations 

68 minutes 

Gr.2 Interview 
Ratings 

60 pupils 
6r .2 Curric. 
Objectives 

214 items 
Gr.2 Textbooks 
(Measurement) 

753 items 
Gr.2 Classroom 
Observations 

52 minutes 

Gr.3 Interview 
Ratings 

60 pupils 
Paper & Pencil 
Tests (ACER) 

92 pupils 
Gr.3 Curric. 
Objectives 

15 items 
fir .3 Textbooks 
(Measurement) 

722 items 
Gr.3 Classroom 
Observations 

MO minutes 
Achievement" 
Test (Gr.3) 

7 items 



PO 
64 
% 





re 




26 




% 


w 




7 




% 





21 
% 



EC 
42 
% 

81 
% 



IF 
15 
t 



LC 
32 



EC 
76 



IT 

22 



IT 

12 
% 



13 



49 
% 



43 



29 



IT 

27 



LC*" 
90 



"TT 

58 
% 

56 
% 



22 



IT 

10 

% 



PO 
33 

TO"- 

27 



EC 
37 
% 

HeT 
53 



LC 
21 



Tc" 
18 



EF 
9 
% 



EC 




13 




% 






"EC 




25 







LC 
87 



TF 
14 



Tc" 
75 
% 



tr 

75 
% 



TF 

86 



IT 

25 
% 



K-S D* 
Probability 
Decision 
D=0.378 
p<0.0C1 
Reject 
'b=6.574' 
p<0.001 
Reject 
D=0.641 
p<0.001 
Reject 

K-S D* 

Probability 
Decision 
D=0.565 
p<0.001 
Reject 
T)=0.W 
p<0.001 
Reje ct 
u=u. 
p<0.001 
Reject 

Inter- K-S D* 
view Prob. 
Dec'n 
07l0"3 



E Paper 

F| K-S D* >0.200 

Prob. Acc. 

OjSTI 0.568 
<0.001 <0.001 

Re j . Re j . 

0.559' 6". 956 

<0.001 <0.001 
Rej. Rej. 



tel. 

oTsbT 0.702 
<0.001 <0.001 
Rej . Re j , 
0.661 0'.^9 
<0.001 <0.001 
Rej. Rej. 



"PO-Pre'opera'tio'n'a'l; EC-Early Concrete; LC-Late Concrete ; 
EF-Early Formal; F-Formal 
*Kolmogorov-Smirnov Goodness of Fit Test: Each Curricular Cognitive Demand 
frequency distribution was compared with that of the corresponding Pupil Cognitive 
Responses to Interview or Paper-and-Pencil assessments. Two distributions were 
considered not significantly different if the probability of observing the 
calculated K-S D was greater than 0.05 (with N = number of pupils). 
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interviews and from the paper-and-pencil tests were in agreement (K-S D = 
0.103; p > 0.200), but the demand/response mismatch pattern continued- The 
curriculum objective, textbook and achievement test demands were, 
respectively, 87%, 75% and 86% at the Late Concrete Level as compared with 30% 
and 20% of the student responses at that lr* and above. All of the 
classroom demands were Late Concrete or Early Formal but 70 to 80% of the 
student responses were at or below the Early Concrete level. 
Measurement, Grades M to 6 

The situation in the Grades M to 6 Measurement strand was found to be 
much like that in Grades 1 to 3, as can be seen in Figure 26, In each of the 
three Division Two grades there are either very few or no demands at the 
Preoperational and Early Concrete levels, in contrast with 18% to 57% of the 
student responses occur ing at these levels, or there is an overabundance of 
Early Formal demands (which implies a shortage of lower level demands). 

Geometry and Graphing 
Geometry and Graphing, Grades 1 to 3 

Figure 27 summarizes the demand/response contrasts found in Gi ^tzz 1 to 3 
in topics in Geometry and Graphing, 

There were significant mismatches between the Grade 1 pupil response 
distribution and the demand distributions of the curriculum objectives, 
textbooks, and classroom. This occurred because there were no demands at the 
Late Concrete operational level to correspond to 41% of the pupil responses 
reaching this level in the contexts of Geometry and Graphing, 

No significant differences were found between the Grade 2 pupil response 
distribution and the corresponding curriculum objective and textbook demand 
distributions. However, a marked mismatch between the Grade 2 classroom 
demand distribution and that of the pupil responses was found. This mismatch 
is due to the large proportion of Early Formal demands (73%) and the very 
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Curricular Demand and Pupil Response Contrasts: Measurement, Grades 4 to 6 
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EF -Early Formal; F-Formal 
*Kolmogorov-Smirnov Goodness of Fit Test: Each Curricular Cognitive Demand 
frequency distribution was compared with that of the corresponding Pupil 
Cognitive Responses to Interview or Paper-and-Pencil assessments. Two 
distributions were considered not significantly different if the probability 
of observing the calculated K-S D was greater than 0.05 (N = number of 
pupils) . 
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Currici'lar Demand and Pupil Response Contrasts: Geometry & Graphing, Grades 1 t) 3 
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small proportion of student responses at this level (2%). It is also 
attributable to insufficient demands at or below the Late Concrete operational 
level . 

In Grade 3 significant mismatches were found in every response/demand 
contrast (with the exception that the Grade 3 test of goodness-of-fit between 
textbook demand and pupil response distributions indicated a reasonable match 
when the interview responses were used and a borderline mismatch when the 
paper-and-pencil responses were used). The curriculum objective, textbook, 
and achievement test demand/response mismatches arose from the sparsity of 
demands at the Preoperational level as contrasted with 26$ and 24$ of the 
pupil responses occurring at that level. The classroom observation 
demand /response mismatch can be attributed to a lack of demands at or below 
the Late Concrete operational level (where 93 to 100$ of the pupil responses 
were found ) . 

Geometry and Graphing, Grades 4 to 6 

As summarized in Figure 28, the demand/response picture in Grades 4 to 6 
is a mixed one. 

All three Grade 4 >>ometry and Graphing demand distributions were 
accepted as bein^ not significantly different from the pupil response 
distribution. 

In Grade 5, all three Geometry and Graphing distributions proved to be 
significantly lifferent from that of the pupil responses. In each case, the 
percentage of demands at or below the Early Concrete level was substantially 
below 59$, the corresponding figure for pupil responses. 

The Grade 6 distributions of the Graphing and Geometry demands made by 
the curriculum objectives and by the achievement test items were not 
significantly different from that of the pupil responses. As for the 
textbooks, there was an overabundance of demands at or below the Early 
O 82 : " ' " 
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Curricular Demand and Pupil Response Contrasts: 
Geometry & Graphing, Grades 4 to 6 
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*Kolmogorov-Smirnov Goodness of Fit Test: Each Curricular Cognitive Demand 
frequency distribution was compared with that of the corresponding Pupil 
Cognitive Responses to Interview or Paper-and-Pencil assessments. Two 
distributions were considered not significantly different if the probability 
of observing the calculated K-S D was greater than 0.05 (with N = number of 
pupils) . 
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Concrete level (56% demands contrasted with 23% responses), which corresponds 
to a lack of demands at or above the Late Concrete level. The Grade 6 
classroom demands for Geometry and Graphing exhibited a significantly greater 
proportion of demands than responses at or below the Late Concrete level (89% 
contrasted with 77%). 
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DISCUSSION OF FINDINGS 

Number of Matches and Mismatches between Demand and Response Distributions 

by Curriculum S trands 

For discussion of general overall patterns the data in Figures 21 through 
28 are sunmarized in Table 2. This table shows by strand the number of 
instances in which the curricular cognitive demand distributions were 
significantly higher (H) than, or lower (L) than, or not significantly 
different (NSD) from, the corresponding student response distributions . The 
data are reported for each grade and for all grades together. 

Table 2 shows that in 55% of all of the demand /response comparisons the 
demand distributions were significantly higher than those of the student 
responses, in 32% of the comparisons the distributions were not significantly 
different, and in 13% of the comparisons the demand distributions were lower 
than the distributions of student responses. The demand distributions 
generally compare favourably with the response distributions in all strands 
except Measurement. 

A trend is evident over the six grades in the Numeration strand. As 
shown in Table 2, all of the demand distributions match or are lower than the 
response distributions in Grades 1 and 2, but there is a gradual shift with 
increasing grade level until all demand distributions are significantly higher 
than those of the student responses in Grades 5 and 6. It appears that the 
program starts ! easy ! and gets ! harder 1 (where ! easy ! and ! harder' are 
assessed in terms of the relative numbers of demand distributions that are 
higher than, no different from, or lower than the corresponding response 
distributions). The number of cases in which the demands are higher are: 0, 
0, 1, 1, 3, 4, for the six grades in order. This can be contrasted with the 
Operations strand where, using the same criteria, the program starts ! harder 1 
(three out of three demand distributions higher), becomes ! easier ! by Grade 4 



Table 2 



Numbers of Matches and Mismatches between Demand and 
Response Distributions by Curriculum Strand 
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H: demand distribution significantly higher than response distribution 



NSD: no significant difference between demand and response distributions 
L: demand distribution significantly lower than response distribution 
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(zero out of four demand distributions higher), and then increases in 
difficulty at Grades 5 and 6 (one out of three and one out of four demand 
distributions higher) . 

The best fit occurs in Operations, where 45? of the demand distributions 
matched the response distributions, 35? of the demand distributions were 
higher, and 20? were lower . Numeration and Geometry & Graphing each have 401 
of the demand and response distrib ,ions matched, 45$ of the demand 
distributions higher and 15? lower. In Measurement the situation is 
dramatically different: 100? of the demand distributions are higher than the 
response distributions. It may be that many aspects of measurement are 
intrinsically highly demanding. The frequent use of scales resembling number 
lines and inferences involving transitivity are two examples. Although number 
lines do not appear in the Numeration strand until Grade 4, the need to read 
scales arises in Grade 2 or earlier in the Measurement strand. 

In Geometry & Graphing the number of matches and mismatches shows no 
particular pattern across the grades. The demand distributions for Grades 3 
and 5 were predominantly higher than the response distributions, with 3 out of 
4 and 3 out of 3 demand distributions higher than those of the responses. 
Grades 1, 2, 4 and 6 show a variety of match/mismatch configurations. 

When looking at Table 2 by grades several features stand out. For 
example, the Grade 1 demand distributions in Operations are all higher than 
the response distributions. Many six- and-sev en-year-olds respond 
Preoperationally in the topics of the Operations strand. However, it is 
difficult to state Operations demands in Preoperational terms. Hence, it is 
not unexpected that all three Grade 1 demand distributions would be higher 
than the corresponding response level distributions, and reference to Figure 
23 confirms that this is, in fact, the case. Since these mismatches result 
from a lack of demands at the Preoperational level to match fhe 29? of the 
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responses which were Preoperational, it may be that the only recourse is to 
give the Preoperational students manipulative materials and experiences in 
which arithmetic operations are embedded in order to provide rudimentary 
concrete activities to bridge the gap to the Early Concrete level. 

Table 2 shows that in Grades 5 and 6 the demand distributions in the 
Numeration strand are all higher than the corresponding response 
distributions. While earlier grades deal mainly with whole numbers, the 
topics emphasized in Numeration in Grades 5 and 6 are "place values greater 
than hundred thousands and less than hundredths," "fractions (decimal and 
common)," and "ratios." The findings of the Calgary Junior High Mathematics 
Project indicated that these topics have an inherently high level of cognitive 
demand As Figure 22 shows, there is a heavy emphasis on Early Formal 
Operational demands in the Numeration strand in Grades 5 and 6, but there is a 
lack of pupil responses at this level. Figure 24 indicates that in the 
Operations strand in Grades 5 and 6 there are substantial nunbers of demands 
at the Early Formal and Formal Operational levels, but in this strand there 
are sufficient student responses at these levels to match the curriculum and 
textbook demands. In order for the computations of the Operations strand to 
be carried out meaningfully, there must be parallel development of nunber 
concepts in the Numeration strand. It is interesting to note that the 
percentage of Early Formal and Formal Operational responses is so much smaller 
in the Numeration strand than in the Operations strand in these grades. This 
is an example of "broken front" development, in which students 1 cognitive 
abilities are more advanced in one strand than in another. 

A graph of the total number of mismatches per grade yields the 
interesting profile shown in Figure 29. This graph shows that in four of the 
six grades the percentage of cases in which the demand distributions are 
higher than the response distributions is fairly consistently in the 40% to 
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Figure 29 

e of Demand Distributions Significantly Higher or Lower than 
Student Response Distributions, by Grade 
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60% range. The two exceptions to this statement are Grades 4 and 5. The 
Grade 5 program stands out as being the 'hardest 1 or the most challenging, 
cognitively, with 85% of the demand distributions higher, and none lower than 
the corresponding response distributions. Grade 4 appears to have the best 
fit between demand distributions and response distributions with only 27% of 
the demand distributions higher and 9% lower. The cases in which the demand 
distributions are lower than the response distributions occur mainly in Grades 
1 and 2. The largest percentage of mismatches is found in Grade 1 where 58% 
of the demand distributions were higher, 33% were lower and only 9% matched 
the response distributions. 

The findings from the comparisons for Grade 4 are of particular interest 
in view of the fact that during the revision of the curriculum for 1982 
complaints from teachers suggested that the then current Grade 4 program was 
too demanding. Adjustments were made at that time in the whole curriculum, 
producing the favourable situation for Grade 4. 

Number of Ma tch es and Mismatches Between Demand and Response Distributions 

by Demand Areas 

Table 3 has been produced from the data in Figures 21 through 28 in order 
to facilitate the discussion of patterns across the grades in each demand area 
(Curriculum Objectives, Textbooks, Classroom Observations, and Achievement 
Tests). This table recoris the number of instances in which the curricular 
cognitive demand distributions were higher (H) than, lower (L) than, or not 
significantly different (NSD) from the student response distributions (for 
each grade and for all grades together) . 

The Curriculum shows the best overall fit with 46% of the demand 
distributions matching, 42% higher, and i2% lov/er than the response 
distributions. The programs for Grades 3 and 4 display the best 
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Table 3 

Numbers of Matches and Mismatches between Demand ana 
Response Distributions by Demand Area 





Curriculum 


Textbooks 


Classroom 


Achievement 
Tests 


Totals 




Grade 


H 


NSD 


L 


H 


NSD 


L 


H 


NSD 


L 


H 


NSD 


L 


H 


NSD 


L 


Total 


1 


2 


1 


1 


2 


0 


2 


3 


0 


1 








7 


1 


U 


12 


2 


I 


2 


1 


1 




2 


3 


1 


0 








5 


U 


3 


12 


3 


1 


3 


0 


2 


2 


0 


*> 


1 


0 


3 


1 


0 


9 


7 


0 


16 


U 


1 


3 


0 


1 


3 


0 


1 


1 


1 








3 


7 


1 


11 


5 


3 


1 


0 


3 


1 


0 




0 


0 








10 


2 


0 


12 


6 


2 


1 


1 


2 


1 


1 


3 


0 


0 


2 


2 


0 


9 


U 


2 


15 


Total 


10 


11 


3 


11 


8 


5 


17 


3 


2 


5 


3 


c 


13 


25 


10 


78 


% of 
Total 


U2j m 


12% 


16% 33% 21% 


77% 


m 


9% 


63% 38% 


0$ 


55% 32% 


13% 


100% 



H: demand distribution significantly higher than response distribution 
NSD: no significant difference between demand and response distributions 
L: demand distribution significantly lower than response distribution 




demand/response fit, each with three matches and one case in which the demand 
distribution is higher. Grade 2 has two matches, one demand distribution 
higher, and one lower, Grades 1 and 6 have one match each, two demand 
distributions higher, and one lower. Grade 5, with only one match, has three 
demand distributions higher than the response distribution. 

With respect to Textbooks, 33% of the demand and response distributions 
match, in 46$ of the cases the demands are higher, and in 21$ the demands are 
lower than the responses. Again, the best match is at Grade 4 where there are 
three matches and one demand distribution higher than the distribution of the 
responses. Grade 3 has two matches and two with the demands higher. Grades 
2, 5, and 6 have only one match each with Grade 2 having one demand 
distribution higher and two lower, Grade 5 with three higher, and Grade 6 with 
f wo higher and one lower than the corresponding response distributions. 
Since only those portions of the textbooks that correspond to the Alberta 
curriculum were analyzed, it might be expected that the match here would tend 
to reflect the match or mismatch in the Curriculum area. Hence, it is not 
surprising that the Grades 2 through 4 textbook demand distributions match 
wel] with the response distributions and the Grades 1, 5, and 6 demand 
distributions match less well, since this is the case with the Curriculum, 

The summary of comparisons between demand distributions and corresponding 
response distributions in the Classroom is particularly noteworthy. Since the 
demands recorded in the Classroom presumably reflect the demands of the 
Curriculum it is not surprising that the best fit between demand and response 
distributions occurs at Grad^ 4. The most critical areas were Grades 5 and 6 
where all the demand distributions were higher than those of the corresponding 
responses. The Classroom demand distributions at Grades 1, 2 and 3 do not 
reflect the demand distributions of the Curriculum as well as one would 
expect. In Grade 1, three demand distributions were higher and one was lower. 
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In each of Grades 2 and 3, three demand distributions were higher and one 
macched. Overall, 77% of the observed demand distributions were higher than 
the corresponding distributions of student responses, only 1M% were not 
significantly different, and 9% were lower. This is particularly interesting 
because the teachers that were observed had volunteered to participate and 
were generally considered to be above average teachers. Also, for the most 
part, they seemed aware of the kinds of learning activities that the observer 
would presumably consider appropriate. 

The Achievement Test findings show that the demand levels were higher 
than student response levels in five of the eight comparisons. Only three 
matches occur. At Grade 3 there was a match in one strand (Numeration), while 
the demand distributions were higher than student responses in the other three 
strands. At Grade 6 there were two matches (Operations and Geometry & 
Graphing), but the demand distributions were higher than the response 
distributions in the other two strands. 

It should be noted that the distributions of student responses were 
obtained late in the fall term, whereas the demands of the Achievement Tests 
reflect end-of-year expectations. Furthermore, the Achievement Test items 
included in the ACLIC assessments did not include any items from the 
computation sections which have lower cognitive demands (largely at the Late 
Concrete Operational level). Similarly, the demands of the Curriculum and 
Textbooks were assessed for the whole school term. The Classroom demands were 
assessed at the end of the school term. Moreover, the teacher sample was 
small, and the ntmber of minutes observed in some strands was very small. 
These factors might well account for the lack of fit where the demands were 
higher than the responses. Any report of a cognitive mismatch should be 
viewed conservatively. 

Even in the light of the preceding cautions, the fact remains that 77% of 
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the Classroom demand distributions were significantly higher than the pupil 
response distributions, which might well lead to mechanical learning rather 
than the understanding, internalization and cognitive development that is 
preferred. However, the large mismatch might well be accommodated by 
supplementary learning activities designed to bridge the gap and promote 
understanding, meaning, and internalization of the concept under study. 

An important theoretical question is: How closely should the demand 
distribution match the corresponding student response distribution? It could 
be asserted that the demand level should be higher than the corresponding 
response level in order to promote intellectual development. However, an 
action plan based on this assertion should include instruction geared to 
bridging the gap between the levels of students 1 responses and the levels of 
demands. Another important consxderation is that even with a "perfect" match 
there are always higher level demands for all but the cognitively most 
advanced in a given grade. 

In any case, the immediate practical question is how large must a 
discrepancy between the demand and response distributions be in order to be 
judged "too large." In the foregoing statistical comparisons, the critical 
K-S D value was roughly 0.25 so that two distributions were considered to be 
significantly different when the maximum difference between the cumulative 
percentage distributions for corresponding cognitive levels exceeded 25%. (A 
difference this large between two distributions drawn from the same population 
would be observed by chance only 5 times in a hundred.) 
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CONCLUSIONS 

The Assessing Cognitive Levels in Classrooms Project has produced data 
analyses and interpretations that provide answers to the three research 
questions posed on page 12. In the following sections, the questions are 
restated along with general answers and then a nunber of specific conclusions 
are drawn. 

1) What levels of cognitive response are demonstrated in 
mathematics topic contexts by Alberta students in each of Grades 1 
through 6? 

In a representative sample of students at each grade level, a wide range 
of cognitive levels of student response was found across the four topic 
strands. In general, about three-quarters of all student responses were at 
the Concrete Operational level (Early Concrete and Late Concrete levels 
together) . The remaining quarter were primarily at the Preoperational level 
in the early grades and at the Early Formal and Formal Operational levels in 
the higher grades. (See Figures 1 to 6.) 

The younger students responded more frequently at the Preoperational and 
Early Concrete Operational levels than did the older students. In Grades 1 
and 2 a substantial proportion of responses were at the Preoperational level. 
The percentage of Preoperational responses dropped as grade level increased 
from Grade 3 to Grade 6. At the Grade 6 level only a very small percentage of 
the responses were rated Preoperational, and the percentage of student 
responses at the Early Formal Operational level was dramatically higher than 
in the earlier grades. None of the Grade 1 and very few of the Grade 2 
students responded above the Late Concrete Operational level, but the 
percentages of Early Formal Operational responses generally increased with 
grade level. In Grades 5 and 6 a small nunber of responses were at the Formal 
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Operational level. 

Figures 5 and 6 show that cognitive abilities develop on a "broken 
front." That is, at any grade level, the percentage of responses at a 
particular cognitive level is not consistent across the strands. For 
instance, at the Grade 2 level 13%, 13%, l \9% and 23% responded at the 
Preoperational level in Numeration, Operations, Measurement and Geometry & 
Graphing, respectively. This indicates that a student may be responding 
the Preoperational level in some strands but at a higher level in others 
(Piaget referred to this phenomenon as one form of decalage.) 

Also, the percentage of responses at the lower cognitive levels in a 

strand may not decrease steadily across the six grades as one would expect. 

For instance, although the percentage of responses at the Preoperational level 

in Numeration generally decreased from Grade 1 to Grade 6, as shown in Figure 

1, it actually increased in Grade 5 as compared with earlier grades. The 

differences in the sophistication of the mathematical content in the strand at 

the various grade levels may account for this discrepancy. For example, it is 

possible that students who responded at a Concrete Operational level to a task 

involving whole numbers in Grade 2 or 3 might respond Preoperational ly in 

Grade 6 in the context of fractions and decimals. (Piaget referred to this 

phenomenon as another form of decalage.) 

2) What are the levels of cognitive demand made on students 
at each grade level by: 

i) the curriculum objectives identified by the Elementary 
Mathematics Curriculum Guide , Alberta Education, 1982, 
~ ii) the prescribed textual resources, 
iii) teacher presentations, and 
iv) representative achievement tests? 

The predominant level of demand is the Concrete Operational. About 

three-quarters of all demands are at the Concrete Operational level (Early 

Concrete and Late Concrete combined). Of the remaining quarter, most occur at 

the Early Formal level, with small percentages at the Preoperational and 
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Formal Operational levels. (See Figures 7 to 20.) 

As would be expected, the demand levels increased with increasing grade 
levels. The numbers of Preoperational demands ranged from a substantial 
number in some strands at Grade 1 to very few, if any, at Grade 6. The 
numbers of Early Formal Operational demands increased from very few at Grades 
i and 2 to a substantial nunber at Grade 6, 

The distributions of Curriculum objective demands showed the greatest 
consistency across strands and the most consistent pattern of increasing 
demands as the grade level increased. Only in Grades 1 and 2 were there any 
Preoperational demands. Early and Late Concrete Operational demands 
predominate from Grades 1 to 4, but in Grades 5 and 6 Formal Operational 
(Early Formal and Formal combined) demands predominate, by a slight margin, in 
all strands except Geometry & Graphing. (See Figures 7 to 10.) 

The pattern of the demands of the Textbooks is similar to that of the 
Curriculun objectives (Figures 11 to 14). 

The Classroom lessons observed made predominantly Concrete Operational 
(Early Concrete and Late Concrete combined) demands in the lower grades and 
predominantly Formal Operational (Early Formal and Formal combined) demands in 
the higher grades. Except in Measurement, the demands usually included some 
Early Concrete demands. In Measurement there were Early Concrete Operational 
demands only in Grade 1; all other demands in the strand were Late Concrete or 
Early Formal. In Grades 1 and 2 in Geometry 4 Graphing there were Early 
Concrete Operational and Early Formal Operational demands but no Late Concrete 
Operational demands. In Grade 6 Operations there were only Early Formal and 
Formal Operational demands. (See Figures 15 to 18.) 

Parts A and b of the 1982 Grade 3 and 1983 Grade 6 Alberta Education 
Achievement Tests were assessed. Their cognitive demands were m?~'nly Concrete 
Operational (Early Concrete and Concrete combined) in Grade 3 and mainly Early 
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Formal Operational in Grade 6 (Figures 19 and 20). There were no 

Preoperational demands, and in only one instance were there Formal Operational 

demands, that being at Grade 6 in Operations. Overall, in Grade 3 the demands 

were 36% Early Concrete, 62% Late Concrete and 2% Formal. In Grade 6, *\% of 

the demands were Early Concrete, 29% were Late Concrete, 60? were Early Formal 

and 7% were Formal. It should be noted that the sections of the tests 

containing only computational items were not assessed. Also, because of the 

small number of test items in any one strand, a change in only one or two 

questions can make a significant change in the distribution. 

3) How well do the distributions of curricular demands (made by 
the curriculum objectives, texts, teacher presentations, and tests) 
fit the distributions of student cognitive responses at each grade 
level in each mathematics topic strand? 

In general, the answer to Question 3) is that the cognitive demands made 
by the curriculum and its interpretations have been found to correspond 
reasonably well to the distributions of student cognitive responses in most 
topics and at most grade levels. In most areas there were some matches, some 
demand distributions lower, and some demand distributions higher than the 
corresponding student response levels. The best overall fit between demand 
distributions and the student response distribution occurred at the Grade M 
level where 64% of the demand and response distributions matched. However, 
there were also some striking mismatches. For example, at Grade 5 in three of 
the four strands all of the demand distributions were higher than the 
corresponding response distributions, and 83% of all of the demand 
distributions in this grade were higher than the response distributions. In 
Grade 1 only 9% of the demand distributions matched the corresponding response 
distributions, but 58% of the demand distributions were higher while 33% were 
lower than the response distributions. (See Figures 21 to 29 and Tables 2 and 
3.) 

98 



Three strands, Numeration, Operations, and Geometry & Graphing, had 
reasonably consistent patterns of matches and mismatches, with 40% to M5% 
matches, 35% to 45% of the demand distributions higher than, 3nd 15% to 20% of 
the demand distributions lower than the response distributions (Table 2). 
The one strand that stands out is Measurement, where 100$ of the demand 
distributions were significantly higher than the response distributions. 

TVo of the four demand areas (Curriculum Objectives and Textbooks) had 
very similar patterns of matches and mismatches across the grades (Table 3)* 
In 46% and 33% of the demand/response distribution comparisons there were 
matches; 42% and 46% of the demand distributions were higher; and 12% and 21 J 
of the demand distributions were lower than the response distributions, 
respectively. 

The Achievement Test demand/re3ponse comparisons produced 387 matches, 
63% of the demand distributions higher and none of the demand distributions 
lower than the response distributions. That the computation items with 
generally lower demand levels were not included in the analysis and that the 
Achievement Tests represent year-end expectations should be taken into account 
when considering these findings. 

The distributions of demands observed in Classrooms matched the 
distributions of student responses less well than the other areas. In all, 
77% of the Classroom demand distributions were significantly higher than the 
corresponding distributions of student responses, while 1U% matched, and 9% 
were lower. The best fit occured in Grade 4 where one demand distribution was 
higher, one was lower, and one was not significantly different from the 
corresponding response distribution. In Grades 5 and 6 all the demand 
distributions were higher than response distributions, but the results in the 
other grades were not so extreme. In interpreting these findings it is 
important to note that the number of teachers involved was small, and the 
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number of minutes observed in some grades and strands was very small. 

In general, the mismatches that were found are most often characterized 
by a lack of suitable material for students still responding Preoperationally, 
especially in the lower grades. But in some instances a lack of suitable 
material for the cognitively most able was also found. 

The statements in the section headed Number of Matches and Mismatches 

Between Demand and Response Distributions by Curriculum Strands lead to the 

following conclusions. 

1. The demand distributions generally compare favourably with 
the response distributions in all strands except Measurement. 

2. The distributions of student response levels in the early 
grades in the Numeration strand were generally higher than the 
distributions of demands, but in the later grades the demand levels 
were generally higher than the response levels. 

3. In the Operations strand the distributions of cognitive 
demands generally matched or were lower than the distributions of 
responses (with the exception of Grade 1, as noted earlier). 

4. The cognitive demands of the Measurement strand were at 
levels consistently exceeding the levels of response of the 
students . 

5. The distributions of cognitive demands in Geometry & 
Graphing generally matched the distributions of responses with the 
exception of Grades 3 and 5 where the demand levels usually exceeded 
the response levels. 

6. Overall, the total program provides the best fit between 
demands and responses at the Grade 4 level. Since there are more 
instances in Grade 5 than in any other grade in which the demand 
distributions are higher than the response distributions, it appears 
the Grade 5 is the most demanding. 

The statements in the section titled Number of Matches and Mismatches 

between Demand and Response Distributions b y Demand Areas lead to the 

following conclusions. 

1 . Across the six trades the patterns of matches between 
cognitive response distr^ jtions and cognitive demand distributions 
were very similar for Curriculun Objectives and Textbooks. The fit 
was best in Grade 4. In Grade 5 the cognitive demand distributions 
were predominantly higher than the distributions of cognitive 
responses. The Curriculm Objectives and Textbook demand 
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distributions were generally closer to the student response 
distributions than were the demand distributions of the Classroom 
and the Achievement Tests. 

2. Generally, the distributions of cognitive demands observed 
in classrooms were higher than the distributions of cognitive 
responses of the students. It should be noted that the sample of 
teachers was limited, and the number of minutes observed in some 
grades and strands was very small. 

3. In the two grades with Achievement Tests, Grades 3 and 6, 
the demand levels of the tests were generally higher than the 
response levels of the students. It should be noted that 
computation items, which have generally lower cognitive demand 
levels, were not included in the assessment. 

RECOMMENDATIONS 

The recommendations which follow are based on the conclusions presented 
above. Their main focus is on increasing the extent to which the 
distributions of curricular cognitive demands natch the distributions of 
student cognitive responses. 

1. It is recommended that the curriculum be reviewed and 
revised w.,ere necessary to include more objectives of lower demand 
levels in order to provide adequate small steps to bridge any gaps 
between the student cognitive response levels and curricular 
cognitive demand levels. This is particularly important in Grades 5 
and 6 Numeration, in Grade 1 Operations, in all grades in 
Measurement, and in grades 3 and 5 in Geometry and Graphing. 

2. It is recommended that the curriculum be reviewed and 
revised where necessary to provide more adequately for the 
cognitively most able. The following cases have been identified as 
ones in which the distributions of curricular demand are lower than 
the distributions of student responses: Numeration, Grades 1 and 2; 
Operations, Grades 2, 4, and 6; and Geometry & Graphing, Gr? 1es 1 
and 6. 

3. It is recommended that learning materials (e.g., prescribed 
textbooks) be supplemented to provide more learning experiences at 
the lower demand levels, especially the Preoperational and Early 
Concrete Operational levels. 

M. It is recommended that suitable strategies such as learning 
activities with appropriate materials, instructional and questioning 
techniques, and suitable assignments and practice exercises, all 
promoting the development of cognitive structures, be provided in 
each classroom so that the teacher can better assist students to 
move from their demonstrated response levels to the higher levels 
being demanded by the curriculum. 
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5. It is recommended that the curriculum be reviewed 
considering both cognitive demands and achievement demands in order 
to more evenly distribute the challenges so that all grades have a 
consistent aemand/rasponse pattern, perhaps even approximating that 
of Graae U. 

6. It is recommended that activities be developed that are 
suitable for groups of students operating across a wide range of 
cognitive levels. Such activities should allow students to operate 
at their own levels and interact productively with other students at 
higher levels. 

7. It is recommended that the "Notes and Comments" sections of 
the Curriculum guide be revised and expanded to provide more 
explicit and appropriate suggestions for developing students 1 
cognitive abilities, 

IMPLICATIONS FOR FURTHER RESEARCH 

1. Although the ACLIC project was an extensive one, it would be valuable 
to investigate in greater depth selected critical topics in each strand. This 
would require more interviews or paper-and-pencil test items reflecting a more 
comprehensive profile of each topic selected. 

2. A study might be conducted to explore whether teaching resources, 
materials, and inservice programs centred on cognitive structures can help 
students bridge gaps between their current cognitive response levels and the 
higher cognitive demand levels of the curriculum and its presentation. 

3. A comprehensive diagnostic and remediation program could be 
undertaken in which interviews or paper-and-pencil items would be structured 
to cover the cognitive aspects of various concepts and skills. Based on the 
strengths and weaknesses exhibited by a student's responses, a remediation 
program could be designed and tested. 

4. A study might be conducted to investigate the cognitive abilities of 
apparently high achieving students. 

5« ft - study might be conducted to determine whether the needs of gifted 
and talented students are being met with respect to developing their cognitive 
abilities. 
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6. Fundamental theoretical questions that have been raised could be 
investigated further. For example, How closely should cognitive demand 
distributions match corresponding student response distributions? Can 
activities and teaching strategies be designed to close the gaps between 
student response levels and program demand levels? Will such activities 
result in higher student achievement? 

7. A study might be conducted to determine whether students 1 
performances change when their teacher is made aware of the contrasts between 
student cognitive response levels and program cognitive demand levels. 

8. Each str and of the secondary mathematics program could be assessed in 
terms of distributions of curricular cognitive demands and student cognitive 
responses. 
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FLOWERS RECORD 1 of 3 



REVISED 



ACLIC INTERVIEW RECORD l FLOWERS (About 10 minutes) 



NAME i 



BOY/SIRL GRADE I 



AGE: 



BIRTHDAY l 



SCHOOL I 



INTER VI EWER I 



DATE l 



CASSETTE l 



COUNTER l 



(Copeland, 1974, 137 to 139| Copeland, 1974b, 26, 27i Piaget, 1932, 

203 to 220) 

MATERIALS! 10 large white flowars 



10 viui Cplastic parfait "glasses", arranged in a 

triangular "tan-pi na" pattern 3 
10 rad flowers 
10 othar flowara 
10 chanilla "atama" 

2 containara for flowara Cone a bottla with a tall, 
narrow neck) tha othar a ehort, wide baakat with a 
floriat'a atyrofoam arrangement block] 



PROCEDURES 

Aak child to put a larga white flower in aach vase. Then remove 
the flower a and arrange them in the atyrofoam block in the baakat. 
Aak child to put a rad flower in each vaaa. Then remove tha rad 
flower a and placa them in the tall, narrow-necked container. 

QUESTION It "Are there aa many flowara hare Cred3 aa there CwhiteJ?" 
(or, "la there the aama number of red flowara aa white flo w er a?") 

"How do you know?" 

If the child aaya that there are more of one kind of flowara than 
the othari Interchange the red and white flowers in the containara ao 
that tha red onea are apraad out and the white ones are bunched 
together. "And now ..." (repeating QUESTION 1 if neceamary) . 
"Where were the flowera before?" . . . "Were they Cthe red ones] 
exactly right?" . . . "And what about thoae Cthe white cnesD?" 



QUESTION 2i "If we put all the flowers into the vaaea with the aama 
number in each vase, how many would there be in each vase?" 

Then introduce the third set of flowers and rapeat the procedure 
for establishing that there are just enough of these flowers for the 
vases. Then repeat QUESTION 2. 

Optional i Repeat QUESTION 2 with chenille "stems." 
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BEST COPY AVAILABLE 
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FLOWERS RECORD 2 of 3 
COGNITIVE LEVELS OF RESPONSE 
EQUIVALENCE <QUE8TI0N 1) 

PREOPERATIONAL! 

Unable to regard equivalences between flowers and 
vaees ae lasting or to use this information to answer QUESTION 1 

u One set of flowers seen as having a larger number 

than the other Cpercctptual distraction producing non-equi valence 3 

m OTHER PREOPERATIONAL RESPONSE/COMMENT i 



EARLY CONCRETE OPERATIONAL! 

u Though fooled by perception, child finds correct 
answer by trial and error or questioning, but can be fooled again (May 
make direct comparison between the sets of flowers without using the 
vimi to compose the equivalences established.) 

n Intuitive composition depending on perceptual content 
and not yet operational (1-1 correspondence without lasting 
equivalence) 

rj OTHER EARLY CONCRETE OPERATIONAL RESPONSE / COMMENT t 



LATE CONCRETE OPERATIONAL l 

Q Child at operational level, no longer swayed by 
perception | the logic of the reversibility of composed equivalences 
overcomes any perceptual distraction (Piaget, 1992, 213) ( N I count 
with the vases. " ) 

u OTHER LATE CONCRETE OPERATIONAL RE8P0N8E/ COMMENT I 



BEST COPY AVAILABLE 
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FLOWERS RECORD 3 of 3 



MULTIPLICATION < QUEST I ON 2) 

PREOPERATIONAL! 

Can make one-one corraapondanca of flower a to vaaaa, 
but if on* aat of flowara ia bunch ad and tha othar apraad out, tha 
letter is aaan aa having mora floweret cannot apply tranaitiva 
property logic (If #BF - #V and #V - «WF, than #BF ■ #WF) 

OTHER PREOPERATIONAL RESP0N8E /COMMENT i 



EARLY CONCRETE OPERATIONALi 

i. Child gradually auccaada by rapaating axparimant or 

by raaponding to interviewer quaationa likat "How many blua flowara 
wara in tha vaaaa?" and "How many whita flowara war a in tha vaaaa?"? 
atill diatractad by parcaptual factora 

OTHER EARLY CONCRETE OPERATIONAL RESPONSE / COMMENT I 



LATE CONCRETE OPERATIONALi 

lJ Immadiata uaa of tha logic of tha tranaitiva 

property, with tha concluaion that ainca ona red flowar and ona whita 
flowar want into aach vasa, thara muat ba tha aama number of rad 
flowara aa whita flowara 

Succaaaful an a war to tha quaationi "If we put all 
tha flowara in tha vaaaa with tha aama numbar in each vast, how many 
flowara would ba in aach vaaa?" and to tha aama quuation rapaatad 
•fter a third aat of tan flowara ia introduced 

u OTHER LATE CONCRETE OPERATIONAL RESPONSE/COMMENT i 



BEST COPY AVAILABLE 
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TOFFEE RECORD i of 2 

REVISED 

ACLIC INTERVIEW RECORD i TOFFEE (About 10 minute*) 
NAME 8 BOY/GIRL GRADE I 



«SEj_ BIRTHDAY! SCHOOL I 

i NTERy jEWER i _ OATEt CASSETTE t COUNTER t 



MATERIALS! A roll of adding machins tap* 

6 baar Sticksrs mounted on cards 
A pair of scissors 
psncil and/or marking pan 

Plastic Stirsticks cut in half lsngthuis* and sidsways (to 
maks thin "sticks" that rasist rolling) 



METHODS (Show ths child a strip of adding machins taps, longsr than 
wids. ) M Ihis is quits a thin pisca of toffss (candy, chssss, . . .). 
rhs bsars want to sat it all up. To b* fair, sach should gst just ths 
sams amount, how shall w* do it? . . . You can uss thsss (psncii, 
scissors, "sticks, 11 . . .)." 

"How did you do it? 11 (or, "Tsll ma what you did.") 

When ths child has dividsd ths whols, askt "Mould thsss 
piscss taksn togsthsr (illustrating by a swssp of ths hand) maks up as 
much as ths whols strip of toffss (candy, chssss, . . .) that ws 
startsd with ... or mors ... or lsss?" . . . 'Tsll mm why." 

Ihsn, bring out a third bsar and rsposs ths p rob la* with a 
nsw strip of adding machins taps. CAltsrnativsly, START with thrss 
bsars* J 

As appropriats, procssd to quartsrs, fifths, or sixths . . . 
using ths sams procsdurs. 



IDENTIFICATION OF COGNITIVE LEVEL OF RESPONSE 
PREOPERATIONAL! 

— rsal difficulty dividing toffss into two squal parts (halvss) , 
for ax amp 1st 

j mors than two parts 
i i approximately squal small portions but rsst of toffss undividsd 
m all of toffss sharsd but unequally 

• i thrss portions (confusing numbsr of cuts with number of parts) 
(Piagst, Inhsldor, Szsninska, 1960, 303) 
OTHER PREOPERATIONAL RESPONBE/COHMENTBi 
BEST COPY AVAILABLE ^ 



TOFFEE RECORD 2 of 2 



EARLY CONCRETE OPERATIONAL J 

— problem of dichotomy solved (i.e., 2 equal parts) 
— no realization that the original whola must 
nacassariiy equal the sum of its original parrs 

OTHER EARLY CONCRETE OPERATIONAL RcSPONSE/COMMENTSi 



LATE CONCRETE OPERATIONAL! 

— trichotomy is solvsd (i.a. , making 3 equal parts) 
and conservation of tha whole is realized intuitively (but not 
operational ly) 

OTHER LATE CONCRETE OPERATIONAL RESPONSE / COMMENTS » 



EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS) i 

* i — trichotomy handled by means of an anticipatory 

schema (i.e., an a priori understanding of the relations between 
fractions sought and the original whole) ? operational conservation of 
the whole 

* i — division into fifths and sixths handled by means of 
an anticipatory schema 

i i OTHER EARLY FORMAL OPERATIONAL (CONCRETE 

GENERAL I Z AT 1 0N8 ) RESPOfiSE/ C0MMENT8 1 



111 
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DKUrtb RCCUHU 1 Of ^ 
ACLIC INTERVIEW RECORDt DRUMS (About IS minutes) 

NHPIti BUY/lilRL GRADE t 

A tofct BIRIHUAYt SLHQULt 

I NTERV iEWEKi DMlfc t CABSETTEt COUNTER! 



Mrtl EKiNLSt itn drums* graduated in aize, ths larqest at least twice 
the size of ths smallest 
Isn drumsticks I wooden toothpicks cut to length of drum 
raoiusJ 

QUESTION It "The drums are going to be in a Parade, ^ringw the 
drums and drumsticks so that each drum is with the right size of 
drumstick." (Discuss until it is clear that the child understands the 
principle of serial correspondence.) 

QUESTION 2t (Once the rows of drums and drumsticks have been arranged 
in correspondence with one another, in clear view of the child, move 
the drums closer to one another and the drumsticks further apart, but 
maintaining the distance between the rows of drums and drumsticks.) 
L Touching one of the drumsJ "Which drumstick will go with this one?" 
(Repeat, choosing in order or at random according to the child s 
answers. ) 

QUESTION 3s (After several repetitions of QUESTION 2. reverse one of 
the series.) "Which drumstick will go with this one?" LAs in 

QUESTION 22 

QUESTION 4 i (One or both series disarranged) "Which drumstick 
belonas to this drum?" 

QUESTION St CWhieh enables determination of "the exact level of the 
child s understanding" (Piaget* 1952. 98)3 (Mingle all of the 
elements of the two series. Pick out a drum, say number 5.) "8ome of 
the drums are coing in the next parade* but not all of them — only 
those that are bigoer (or smaller) than this drum. Find the 
drumsticks belonging to the drums that are going in the parade and 
those belonging to the drums not going." 

I these five guest ions, which must pe posed separately to the child, 
can be reduced to three more general problems for systematizing the 
results t 

1. constructing a serial correspondence or similarity (Q. 

1) 

2. determining a serial correspondence when it is no 
longer directly perceived (transition to ordinal correspondence) (U. 2 

and Q. 6) 

5. reconstructing the ordinal correspondence when tie 
intuitive series are destroyed (U. 4 and U. 3) (Piaget, 1952, 98) 3 




BEST COPY AVAILABLE 
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DRUMS RECORD 2 of 3 
CONSTRUCTION OF SERIAL CORRESPONDENCE (QUALITATIVE SIMILARI1Y) CU. I J 
PREOPERATIONAL! 



— child unable to make drums and drumsticks 
corrtioona and unable to form corrtctiv isolated unci (Piaaet. 1V32. 

UIHtR PREOPERATIONAL RESPONSE/COMMENTS! 



EARLY CONCREIb OPERA I 1UNHL: 

— child capable of spontaneous construction of 
correct series following some trial and error 

— successful solvinq of problem of serial corresoondence 
^especially bv the method of double seriation) (Piaqet, 195^, 102, 
1U3) 

OTHER EARLY CONCRETE OPERATIONAL RESPONSE/COMMENTS i 



LATE CONCRETE OPERAIIUNALs 

— child continually considers the set of 
relationships between all of the elements, at each new step lookmo 
tor the biqqest (smallest) of the remaining elements (no trial or 
error ) 

— ease of operation by immediate correspondence, 
without previously seriatinq drums and drumsticks (Piaqet, 1952, 106) 

OTHER LATE CONCRETE OPERATIONAL RESPONSE /COMMENTS! 



SERIAL CORRESPONDENCE TO ORDINAL CORRESPONDENCE LU. 2 h U. 3J 
PREOPERATIONAL! 

— child loses all notion of correspondence whom one 
of the series is displaced, merely choosing elements opposite one 
another 

i OTHER PREOPERATIONAL RESPONSE/COMMENTS i 



EARLY CONCRETE OPERA 1 lONALi 

i t — child tries to find the correct correspondence "by 
empirical means or by counting" (Piaqet, 19S2, 106) but constantly 
confuses the riqht position with that of the preceding term 

• ! OTHER EARLY CONCRETE OPERATIONAL RESPONSE/COMMENTS I 

BEST COPY AVAILABLE 116 
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DRUMS RfcCUKD i o* i 



LATE. CONCRETE OPERA tlUNMLl 

— problem solved bv coordinating estimate ot required 
oomition with that ot cardinal value of sets in question unvoivinq 
both qualitative serial and ordinal numerical correspondences) 

(Kiaqet. I9t>^. 1U6-114) 

OTHER LATE CONCRETE OPERATIONAL RESPONSE/COMMENTS I 

RECONSTRUCTION OF CARDINAL CORRESPONDENCE CQ. 4 * Q. 53 

PREOPERATIONAL! 

i — no correspondence, series not reconstructed, 

elements chosen at random 

• OTHER PREOPERATIONAL RESPONSE/COMMENTS l 

EARLY CONCREIfc OPERA I lONALt 

— attamot to solve problem lacks systematic 
re-senation or card 1 nation 

OTHER EARLY CONCRETE OPERATIONAL RESPONSE/COMMENTS i 
LATE CONCRETE OPERA I lUNALt 

•i — reconstruction achieved by co-ordination of 
ordination and csrdi nation (Placet, 1932, 115-121) 

OTHER LATE CONCRETE OPERATIONAL RESPONSE/COMMENTS t 
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BLOCKS 1 1 of 2 

REVISED 

ACLIC INTERVIEW RECORD! BLOCKS 1 (About IS * inutas) 

NAMEl_ . BOY/GIRL GRADE i 

AGE» BIRTHDAYt SCHOOL i 



INTERVIEWERi DATE» CASSETTEi COUNTER » 



MATERIALS! 20 Flats, 20 Longs, 20 Units, I Dia 
BLOCKS! Cards (am indicatad balow) 
P«nci I, irntr 

Shaat of Brimtol Board (or facsimile) on which to roll Dim 



PROCEDURES i 

A. "Raca to SO" 

— "Hcva vou usad thasa CB, F, L, U3? What do you call . . . ? 
— Intarviawar and child taka turns rolling Dia 
— ". . . soonast to 100." 

— roll for "unit*" until anough to axchanga for "long" (Uaa 
child's words.) "How many "units" in a "long"? (. . . "flat") 

— aftar a "long" racaivad, roll for "longs" until 100 raachad 

or pass ad 

i i Succassful li Unsuccassful 

COMMENT I 



B. "Show ma 1 361 Cprintad on a card! using as faw piacas of 

wocd as you can . " 

i i Succassf ul I i Unsuccassful 

COMMEN < I 

(Successful rasponsa is at laast EARLY CONCRETE OPERATIONAL.) 

C. "This matar counts tha numbar of paopla that go in through a 
gat» to a hockay gama. . . 



I l t 13191 COn card3 

"How many hava alraady gona through tha gata? 
u Succassf ul u Unsuccassful 

COMMENT i 

(Succsssful rasponsa is at laast EARLY CONCRETE OPERATIONAL.) 



BEST COPY AVAILABLE 
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BLOCKS 1 2 of 2 

"Tall mm what tha matar will mhow whmn on a mora parmon ham 
gona through. " 

Succammful < i Unmuccammful 

COMMENT i 

(Succmmmful ramponma im at laaat LATE CONCRETE OPERATIONAL.) 



D. Fha numomr chat i« 2 than 20 ii t CQn card} 

i i Succamsful u Unmuccmmmf ul 

COMMENT i 

(Succnmmful ramponma im at lmamt LATE CONCRETE OPERATIONAL.) 

Cl-f not muccmmmful, urn* blockm. 3 (EARLY CONCRETE 
OPERATIONAL) 

COMMENT! 

Cl-f appropriate, try BL0CKS2 Car da. 3 



BEST COPY AVAILABLE 



BL0CKS2 i of 2 



REVISED 

ACLIC INTERVIEW RECORD i BLQCK82 (REV) 





(About IS minutes) 




NAMEi 


BOY/GIRL GRADE t 




ASEi 


BIRTHDAY I SCHQOLl 




INTERVIEWED 


DATEi CASSETTE t 


COUNTER i 


MATERIALS! 


4 Blocks, 20 Flats, 20 Longs, 20 Units, 
BL0CK82 Cards (as indicstad balow) 
Panci 1, eraser 


1 Dia 



Shaat of Bristol Board (or facsimile) on which to roll Dia 



PROCEDURES i 

A. "Raca to 100" 

— "Hrve you usad thase CB, F, L, U3? What do you call . . . 7" 
— Interviewer and child take turns rolling Dia 
— ". . . soonest to 100." 

— roll for "units" until enough to exchange for "long" (Use 
child's words.) "How many "units" in a "long"? (. . . "flat") 

— after a "long" received, roll for "longs" until 100 reached 

or passed 

* * Successful i -j Unsuccessful 

COMMENT e 



B. "Show me L SfiJ Cprinted on a card} using as few pieces of 
wood as you can. " 

i i Successful i i Unsuccessful 

COMMENT i 

(Successful response is at least EARLY CONCRETE OPERATIONAL. ) 

C. "This meter counts the number of people that go in through a 
gate to a hockey game. . . 



' I I COn card 3 

"How many have already gone through the gate? 
u Successful lj Unsuccessful 

COMMENT l 



(Successful response is at least EARLY CONCRETE OPEIWTIQjNAVcK 

ErJc best copy available 120 ^ 



BL0CKS2 2 of 2 



"Show me what the meter will show whan on» mora parson has 
gona througn. 

i ! i i i T CQn c«rd3 

Succesafui Unauccaaaful 

C0MMEN1 j 

(Succaaaful raaponaa is at laaat LATE CONCRETE OPERATIONAL.) 

U. fha nuwoar that la 2 laaa t han 50 l a COn card 3 

i i tiucccaatul i.i Unauccaaaful 

COMMENT I 

(Succaaaful raaponaa ia at laaat LATE CONCRETE OPERATIONAL.) 

Clf not succaaaful, usa biocka.3 (EARLY CONCRETE 
OPERATIONAL) 

COMMENT i 

E. "Can you subtract?" 
56 

-33 COn ccrdl 

i. i Successful i j Unauccaaaful 
COMMENT (Plaaaa aava child 'a work. ) t 

(Succaaaful raaponaa ia at lsast LATE CONCRETE OPERATIONAL.) 

32 
zl& 

"Tall as what you did Cand why 3 whan you war a working that 

out. " 

* j Succaaaful i.j Unauccaaaful 
COMMENT (Plaasa sava child a work.M 



Clf unauccessf ul , usa F, L , U. 3 (CONCRETE OPERATIONAL) 
Clf appropriate, tryi 102 

ERIC BEST COPY AVAILABLE 121 13§ 



BL0CKS3 1 of 3 



REVISED 

ACLIC INTERVIEW RECORD I BL0CKS3 
(Grada 3, About 15 minutaa) 

NAMfc: BOY /GIRL GRADE I 

AGE: BIRTHDAY! SCHOOL l 

INTERV IEWER! DATE* CASSETTE! COUNTER! 



MATERIALS! 4 Blocks, 20 Flats, 20 Longs, 20 Units, 1 Dia 
BL0CKS3 Car da (aa indicatad balow) 
Kanci 1 , eraaar 

Shaat of Briatol Board (or facaimila) on which to roll Dia 



PROCEDURES! 

A. "Raca to 100" 

— "Hava you uaad thaa* CB, F, L, U3? What do you call . . . ?" 
— Intarviawar and child taka turna rolling Dia 
— ". . . aoonaat to 100." 

— roll for "unita" until anough to axchanga for "long" (Uaa 
child's words. ) "How many "unita" in a "long"? (. . . "flat") 

— aftar a "long" racaivad, roll for "longa" until 100 raachad 

or pasaad 

• • Succaaaful li Unauccaaaful 

COMMENT i 



B. "Show ma 13651 Cprinted on a card} using aa faw piacaa of 
wood aa you can. " 

* i Succaaaful i i Unauccaaaful 

C0MMEN r i 

(Succaaaful raaponaa ia at laaat EARLY CONCRETE OPERATIONAL. ) 

C. "This matar counta tha numbar of paopla that go in through a 
gata to a hockay gana. . . " 

I I tfrJ_£191 COn card 3 

"How many hava alraady gona through tha gata?" (Succaaaful 
raaponaa ia at laaat EARLY CONCRETE OPERATIONAL.) 

i i Succaaaful i i Unauccaaaful 

COMMENT i 

(Succaaaful raaponaa ia at laaat EARLY CONCRETE OPERATIONAL.) 



9 
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BL0CK83 2 of 3 

"Show mm what tha matar will show whan ona mora peraon ham 
gona through. 

i •, { ; l I COn card 1 

Succaaa+ul < j Unauccaaaful 

CCIiMENI (Plaaaa aava or racord child a raaponaa. ) t 

(Succaaaful raaponaa ia at laaat LATE CONCRETE OPERATIONAL.) 

L>. Tha numbar that n 2 laaa than 300 it ~ COn 

card J 

>.. Succaaaful i i Unauccaaaful 

COMMENT t 

(Succaaaful raaponaa ia at laaat LATE CONCRETE OPERATIONAL.) 

Clf not auceaaaful, uaa blocka.3 (EARLY CONCRETE 
OPERATIONAL) 

E. "Can you aubtract?" 
327 

=322 COn card 3 

i • Succaaa-ful u Unauccaaaful 
COMMENT (Plaaaa aava child a work.)i 

(Succaaaful raaponaa ia at laaat LATE CONCRETE OPERATIONAL.) 

702 

"Tall aa what you did, and why, whan you wars working that 

out." 

u Succaaaful i t Unauccaaaful 
COMMENT (Plaaaa aava child'a work.)! 

(Succaaaful raaponaa with logical applanation ia at laaat 

EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS BEING FORMED) . ) 

Clf unauccaaaful, uaa F, L, U.J (CONCRETE OPERATIONAL) 
BEST COPY AVAILABLE 123 



BL0CKS3 3 of 3 



4 002 

= 25 

"Fall ma what you did Cand why] whan you wara working that 

out. " 

• Succaaatul , Unauccaaaful 

COMMENT (Plaaaa cava child a work.)! 



(Succeaafui raaponaa with logical explanation ia at laaat 

EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS BEING FORMED).) 

Clf unauccaaaful, uaa B, F t L t U. 3 (CONCRETE OPERATIONAL) 



141 
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ACLIC INTERVIEW RECORD — PARKING (About 10 minutes) 



NAME: 




BOY /GIRL GRADE: 




AGE: 


BIRTHDAY: 


SCHOOL: 




INTERVIEWER} 


DATE: 


CASSETTE: 


COUNTER: 



MATERIALS: Eleven toy ciri, 7 of one color, 4 of another. 
Parking lot mat. 

PROCEDURE: Interviewer and child togathar park aavan car* than four 
can. Child drivaa all tha cara out of tha parking lot. Child parka 
four ciri than ona of tha aavan. 



QUESTION: If you finiah parking all tha cara, will all tha atalla ba 

full? 

<If ya») , Will thara ba any cara left ovar? If incorract hava tha 
child continua parking tha cara and aak tha quaation again. 

COGNITIVE LEVEL OF RESPONSE 

PREOPERATIONAL: 

Child ia unabla to maka one-to-one corraapondance. 

. : Child ia unabla or unwilling to maka any prediction. 

. i Child makes incorrect predictiona and doea not change 
them after completing the taak. 

OTHER PREOPERATIONAL: 



EARLY CONCRETE OPERATIONAL: 

. Child makea incorrect prediction (a) but changea hia mind 
aa ha complatea tha taak. 

, j OTHER EARLY CONCRETE OPERATIONAL: 



LATE CONCRETE OPERATIONAL: 

u Child immediately predicts correctly. 

! j OTHER LATE CONCRETE OPERATIONAL! 



9 BEST COPY AVAILABLE 125 



ACLIC INTERVIEW RECORD — COOKIES 



BOY /GIRL iSRADE; 



BIKTHDAy : 



SCHOOL: 



i'N f LRV itwth : 



CASSETTE: 



luuN I ER: 



riM i Et< 1 nLb : forzv Dingo cmps. 

Cara kS 1/2 >: ti) ai vided in halt, nai ves marked 
" Yesterday" and •■ Today , 11 

DIRECTIONS t: - • . dov ^girl) likes cookies that mother manes 

. . . yesterday motner sent 4 cookies for morni ng 
r ece35 and 4 tor afternoon (Act out with Chios on card , "Yesterday" 
side. ; 

. . . yesterday he (she; ate 4 cookies in the morning 
and 4 in tne atternoon 

. . • todav, mother again sent 4 cookies for the 
morninq and 4 for the afternoon (Act out on "Today" side.) 

. . . out today he (she) was so busy he (she) only had 
time to eat 1 cookie in the morning and saved the rest of the cookies 
to eat in the afternoon (hove three cookies over next to the four for 
"today s" afternoon.;. 

QUESTION t: Did the boy (girl) have more cookies yesterday (pointing 
to an of yesterday s cookies) or more cookies today (pointing to ail 
of todav s cooHes; or did he (she; have the sa;.,e on both days? Tell 
me now vou know. 



QUESTION i: COGNITIVE LEVEL OF RESPONSE 

PREQPERAI IONAL: 

Child does not know or is not certain which day had 

more chips. Justification, if any, is based on perception. 

OTHER PREOPERATIONAL: 



EARLY CONCRETE OPERATIONAL: 

Child initially chooses one day as having more than the 
other. When pressed for justification suggests counting and discovers 
they both have eight. 

OTHER EARLY CONCRETE OPERATIONAL: 
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CQOH IES 2 



Lhila knows that both aays have the same number even 
without counting. Justifies on the basis o-f equality o-f number, on 
Dasis of reve^si di 1 1 tv (they c^n be rearranged as thev were;, or on 
tne oasis o* identity (none were added or taken away, they are the 
same* . 

Of HER LAT£ CONCRETE OPERATIONAL: 



OLkfcUUUNS a! s fake 24 chips and put them into two cieariy unequal 
piles, one tor the stuoent , one for the interviewer. 



GnJhb ! I ON 2: SuDDOse 1 Dut these cookies into two piles, these vthe 
larger Dile) tor /ou ana these (the smaller pile) for me. Would that 
be *air" wnat coula vou do with all these cookies to put them into 
two oiles so that it woula be fair? Show me how you would do it. 



PREGPERA1 10NAL: 

Chi la juages piles to oe "fair" or child makes piles 
"equal" by estimation, without counting or checking in any way. 

OTHER PREOPERATIONAL: 

E^RLY CONCRETE OPERATIONAL: 

Chi la eaualizes piles by a series of trials and errors, 
counts or matches to verify success. 

OTHER EARLY CONCRETE OPERATIONAL: 

LATE CONCRETE OPERATIONAL? 

Child shares systematically by putting all in one pile 
and removing two (or an equal number for each person) at a time, or 
uses number facts to make two equal piles. 

OTHER LATE CONCRETE OPERATIONAL: 



QUESTION 2: COGNITIVE LEVEL OF RESPONSE 
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DIVIDED BOXES RECORD 1 ot 2 



ACLIC INTERVIEW RECORD I DIVIDED BOXES (About 5 minutes) 



NAME: 



BOY/GIRL 



GRADE; 



AGE: 



BIRTHDAY; 



SCHOOL; 



INTERVIEWER: 



DATE; 



CASSETTE; 



COUNTER: 



MATERIALS: Two identical boxes, open at top but with a divider 
a* shown (about 10 cm x 15 cm x 2 cm). Twenty-four 
small blocks in each box. 

DIRECTIONS 1* With all the blocks on one side of the divider in each 
box, ask ths child whether the two boxes are the same (whether they 
have ths same number of blocks in them). If necessary, suggest 
counting the blocks. In child's view explain that you will move some 
o-f tne blocks to one side of the divider; move six to the opposite 
side, Isaving 18. Explain that in the other box you will also move 
some blocks, but that you do not want the child to see what you are 
doing. Arrange the box so that it is a mirror image of the first box. 
With your hand covering the six blocks on the one side of the second 
box, show the two boxes side by side. 

QUESTION li Can you tell me how many blocks are hidden under my hand? 
If the answer sounds like a guess, ask questions such asi Are you 
sure? Is there any way you could know for sure, instead of just 
thinking thsre might be that many? 



PREOPERATIONAL; 

Child does not know, or guesses, or estimates. 

OTHER PREOPERATIONAL RESPONSE/COMMENTS; 



EARLY CGNCRETE OPERATIONAL: 

Child guesses six and supports this by reference to 
the six in other box, but does not verify that the other sides of each 
box each have the same number (18). 

• i OTHER EARLY CONCRETE OPERATIONAL RESPONSE/COMMENTS i 



COGNITIVE LEVELS OF RESPONSE 
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DIVIDED BOXES RECORD 2 of 2 



LATE CONCRETE OPERATIONAL! 

Child determines that there are six by computation (24 
- 18 » N f 18 «■ N * 24, etc.), by counting on from 18 to 24, or by 
reference to the fix and 18 xn one box and the 18 and six in the 

other. 

OTHER LATE CONCRETE OPERATIONAL RESPONSE/ COMMENT: 



DIRECTIONS 2: (May be used to verify child's method of solution.) 
Take up one box and explain that you are going to move some blocks 
from one side to the other without the child seeing the moves. 
Arrange the box with eight on one side and sixteen on the other. 
Present the box with the eight covered. 



QUESTION 2i As before. 



NOTEs A child who notices that there are fewer showing so there must 
be more hidder is using compensation. If this idea is applied as an 
estimation, then an SARLY CONCRETE OPERATIONAL response is indicated. 
If the child argues that since there are tws fewer showing (16 instead 
of 18), there must be two more hidcton (10 rather than 8), a LATE 
CONCRETE OPERATIONAL respcns© is indicated. 



BEST COPY AVAILABLE 
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I os braoe 1 teacners, brouo u 
Re: Divioed Boxes 

Fhis task with 24 blockm m each of the two boxes will probably 
be solved by older chiidrtn through counting, but soma children at the 
beginning of grade I may not be able to count 24 small object* 
reliably, bo, the interviewer uhould present this task in such a way 
that it can be solved even without counting. 

When first presenting tne two boxes with all 24 counters on one 
side, make sure that the boxes are arranged identically (for example, 
four rows of six in each box). Then when presenting 6 and 18 in one 
oox and 18 and a hidden number in the other, make sure that the two 
groups of 18 are identically arranged (for example, three rows of 
six J. Finally, when presenting 8 and 16 and 16 and a hidden number, 
be sure to arrange the blocks so that the two boxes are mirror images 
of »ach other. 

In assessing the cognitive level of the response, note that 
counting is not a requirement for the LATE CONCRETE OPERATIONAL level. 
A child who argues that there are "just as many 11 (even if he does not 
know how many) on the corresponding sides of the two boxes may be 

working at the w.^TE CONCRETE OPERATIONAL level. 
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LENQ T H RECORD i O t 



ACLIC INTERVIEW RECORDS LENQTH (About 5 mxnutmm; 



REVISED 



NAME I 



BOY/BIRL OR APE l 



MGEs 



INTERVIEWER! 



MATERIALS: 



BIRTHDAYl 



DATES 



SCHOOL I 



CASSETTE I 



COUNTERi 



Two smtm of task cardm (Al - A6 and Bl - B5) 

Coffmm mtxr mtickm identical to thorn* on card* Al - A6 

Strips of papmr, pencils 



PROCEDUREi Show thm child thm coffmm stir mtickm and mxplain that thi 
cardm (Al - A6) you will mhow him (hmr) havm mticxs likm thmm glumd 
onto thmm. Am you prmmmnt mach card amk "Arm thmmm two mtickm both 
thm mama lmnqth or im onm mtick longmr than thm othar? (Which one is 
longmr?)" Also ask thm child to tmll or show how hm knows. 



Introducm cards Bl ~ B5 mxpl mining that thmsm cards mach havm two 
linms drawn on squarmd papmr on thmm. Ask "Arm thmmm two linmm thm 
mamm lmngth or im onm longmr than thm othmr? Which onm? How do you 

knowV" 



SUMMARY OF RESPONSES 

Thm following abbrmviationm may bm ummd to dmmcribm ir< hodm. 

P - Pmrcmptxon - Child bamm^ him anmwmr on pmrcmption (m.g., "it 
lookm longmr.") 

0 - Onm mnd - Child notmm that onm mnd of onm linm mxtmndm bmyond thm 
othmr, without conmidmring thm rmlationmhip of thm oppomitm mndm. 

S - Straightmn - Child argumm that if thm curved or brokmn linmm on 
cardm Bl, B2, and B4 wmrm mtraightmnmd thmy would bm longmr. 

A - Align mndm - Child attmmptm to comparm corrmmponding mndm of linms 
(mmpmcially on cardm Al, A2, and BS) , 

M - Mmamurm along - Child ummm a tool carmfully placmd along thm 
lmngth of thm objmct. 

T - Tranmitivity - Child comparmm two diffmrmnt objmctm with a 
movmablm tool and argumm that if thmy both match thm tool thmy mant bm 
mqual • 

1 - Inaccuratm - Child makms small mrrorm uming mmamuring tool and 
concludms that thm mtickm in card smt A arm mlightly diffmrmnt in 
lmngth. 

Othmr Abbrmviationm/Commmntmi 
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C.M.1 
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IDENTIFICATION OF COGNITIVE LEVEL OF RESPONSE 
PREOPERATIONAL » 

< i Parcaotion i i Qna end 

Othar avidanca -for PREOPERATIONAL laval of rasponaai 



EARLY CONCRETE OPERATIONAL! 
n Aliqn and* 

i i B3 ineorract, othara in B aat corract 

Othar avidanca for EARLY CONCRETE OPERATIONAL laval of raaponaai 



LATE CONCRETE OPERATIONALi 

i i tiaaaura alonq D Tranaitivitv 

Othar avidanca for LATE CONCRETE OPERATIONAL laval of raaponaai 
CD ? r BEST COPY AVAILABLE , , n . . > ' - '» '■ ?f 
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riME RECORD 1 of 2 



REVISED 



ACLIC INTERVIEW RECORDi TIME 



(About 10 mmutas) 



NAME I 



BOY/SIRL GRADE i 



hG£i 



BIRTHDAY! 



SCHOOL! 



INTERVIEWER! 



DATE! 



CASSETTE! 



COUNTER! 



<Piaget, 1969. 188-195) 



MATERIALS! Stop-WA^h (one complete rotation in 1/2 minute (30 
aaconda) ) 

Matronoma or tacalmile (adjustable) Cto producv l beat 

par aacondJ 
Upaqua cap -for at op-Match 



QUEST lUNfa! 

"Count up to 15 in time with tha matronoma, looking at tha hand 
of tha atop-watcn. " [Which advancaa -from 0 to 15 aaconda in tha aama 
time J 

(Maak tha atop-watch.) "Count up to 15 again, but thia timm 
twica aa quickly . . . count two number* to every beat. . . . How far 
do you think that the Chidden 1 hand of tha atop-watch want while you 
were counting faater? Why?" 

i PREDICTION! Hand at 



"Doea counting quickly take more tima than counting alowly . . . 
or laae time . . . or tha aama amount of tima?" 

"Doea the watch go mora alowly at one time and more quickly at 
another ... or dome it always go tha aama?" 



PREOPERATIONAL! 

— child thinka atop-watch hand rune usre or laae rapidly 
according to tha apaad of work whoae duration ib Lemg timed (in thia 
caae, "counting to 15") 

ii —PREDICTION OFF <4.». , greater or leaa than 7 1/2) 
i J OTHER PREOPERATIONAL REBPONSE/COhhENTSi 



IDENTIFICATION OF COGNITIVE LEVEL OF RESPONSE 



BEST COPY AVAILABLE 
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TIME RECORD 2 a* 2 



EARLY CONCRETE OPERATIONAL 

— inability to correlate tha work dona by oneeelf (tna 
count ot IS) witn tna ataady motion of tna etopwatch nana 
(appreciation of tna conaarvation of valocitv but inability to apply 
it to mora tnan ona moving body; 

— re+uaal to maka any oradictiona on tna grounda tnat it la 
imooaaibia to do ao 

— inaoiiitv to aacriba a uniqua unit of tima or a common 
duration to motiona navmg different veiociCiea 

— tna two counting apaada comparad diractly without 
r«fer*nce to time duration maaaurad by watcn 

— PREDICTION OFF (i.a., graatar than or laaa than 7 1/2) 

OTHER EARLY CONCRETE OPERATIONAL RESPONSE/COMMENTS i 



LATE CONCRETE OPERATIONAL: 

--predicts* that tha hand will atop bafora 19 (realizing 
that tha spaad of tha watch la not affactad by tha apaad of tha work 
timad) , but guessaa inaccurately 

i ' OTHER LATE CONCRETE OPERATIONAL RESP0N8E / COMMENTS t 



EARLY FORMAL OPERATIONAL (CONCRETE GENERAL I 2 AT IONS) t 

O — PREDICTIONS 7 1/2 (exact correlation betwean taak 
duration and diaplar ement of stopwatch hand) (Piaget, 1969, 194) 
—PREDICTIONS about 7 1/2, with logical explanation 
OTHER EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS) 
REBPONSE/COMMENTSs 
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WEIGHT RECORD 



1 of 3 



ACLIC INTERVIEW RECQRDl WEIGHT (About 15 minutes) 



NAME I 



BQY/GIRL GRADE 1 



AGE t 



BIRT HDAY* 



SCHOOL! 



I NTERVI EWER: 



DATE* 



CASSETTE; 



COUNTERS 



MATERIALS j Fhree pebbles whose weight cannot be guessed -from the 



volume 
Beam balance 
Two small empty boxes 

Three balls of modelling clay, varying in size and with 
the smallest containing some lead shot, the 
second-smallest a pebble, and the largest of clay only 
Three balls of modelling clay as in the preceding descrip- 
tion but with the heaviest of medium size, and the 
lightest the largest 
Six pebbles whose weight cannot be determined by 

inspection alone 
Three pebbles of identical volume but different weight 
Ten clay balls of the sa^r v-^ume but different weights 
Three visually identical match boxes, one filled with 
sand, one filled with matches, and one empty 



PROBLEM I 

(Show child three pebbles whose weight cannot be guessed from 
their volumes. Say that the balance can be used to weigh the pebbles, 
or they can be weighed in the hand, whichever the child wishes.) "The 
rule for this game isi You must never touch more than two pebbles at 
a time." (Hand child two identical empty boxes for weighing the 
pebbles two at a time) "Put the heaviest pebble here (pointing to one 
side of table), put the lightest there (pointing to the other side), 
and the other in the middle." 

COMMENTS; 



PROBLEM II. 

(Hand the child three balls of modelling clay, the smallest 
containing lead shot, second-smallest a pebble, largest only clay.) 
"Thess three balls do not have the weight they seem to have, so weigh 
them two at a time and try to put them in order from heaviest to 
lightest (or lightest to heaviest) . M 

(Repeat the preceding, but with the heaviest of medium size and 
the lightest the largest.) 



COMMENTS i 
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WEIGHT RECORD 2 of 3 



PROBLEM III. 

(First, give child -four to six pebbles who** weight differences 

cannot be seer, by inspection alone, and then, three pebbles of 

identical volume but different weights. Each time, ask the child to: 

. . .) "Arrange these in order from lightest to heaviest (or, 

heaviest to lightest) by weighing them two at a time." 

COMMENTS: 



PROBLEM IV. 

(Show the child ten clay balls of the same volume but different 
weights.) "Arrange these in order of increasing weight <or, from 
lightest to heaviest)." CNo two-at-a-time restriction this time] 

COMMENTS: 



PROBLEM V. 

(Hand the child three visually identical matchboxes, one of which 
is filled with sand, another with matches, and the third empty.) 
"These matchboxes are not the same weight. One is filled with sand, 
one with matches, and one is empty. Weigh them in your hand. Watch 
where I put the boxes." (Shuffle the boxes around and deliberately 
arrange them on the table in the form of a triangle.) "I'm going to 
ask you three questions and I'd like you to answer them by pointing to 
the right boxes, without opening or touching them.) 

QUESTION VI. "This box (A) is heavier than that one (B> , 
and that one (B) is heavier than this one (C). Which is the heaviest 
of the three boxes? And which is the lightest?" (Piaget and 
Inhelder, 1974, 1SS) 

QUE3TI0N V2. "This box (A) is heavier than that one (B> , 
and this one (C> is lighter than that one (B> . Which is the heaviest 
of the three? And which is the lightest?" (Piaget and Inhelder, 

1974, 183) 

QUESTION V3. "This box (B) is lighter than that one (A), 
and heavier than this one (C> . Which is the heaviest and which is the 
lightest of the three?" (Piaget and Inhelder, 1974, 185) 

COMMENTS: 
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WEIGHT RECORD 3 of 3 



COGNITIVE LEVEL OF RESPONSES 



PREOPERATIONAL. Lack of composition. 

— unabla to solva Probiama 1 and II bacauaa of 
weighing only tv* ■> or thraa objecte, often ona at a time and without 
any corral ati on (PiaQat and Inhaldar, 1974, 185) 

—OTHER PREOPERATIONAL RESPONSE (S) x 



EARLY CONCRETE OPERATIONAL. Empirical aariation. 

— also unabla to solva Probiama I and II but becausa 
tha relations ara aatabliahad by co-ordinating isolatad pairs 
(e.g. , A > 8 and A > C> 

— in Problem III establishes that A > B and C > D, 
failing to appreciate that thia telle nothing about the relationships 
between A, B and C, 0 

— attacka Problem IV (aimple aariation) empirically 
but -faila to co-ordinate successive constructions 

— unable to solva Problem V (Piaget and Inhelder, 
1974, 183) 

—OTHER EARLY CONCRETE OPERATIONAL RESPONSE (S) l 



LATE CONCRETE OPERATIONAL . Operational seriation (concrete). 

— correct sari em (A > B > C) conatructed for Probiama 
I and II by co-ordinating all the relatione 

— correct seriation for Problem IV 

— unable to construct the logical system needed to 
solve Problem III becauae of a failure to co-ordinate the inverae 
relatione (B < A and B > C, for example) in Question V3 (Piaget and 
Inhelder, 1974, 185) 

—OTHER LATE CONCRETE OPERATIONAL RESPONSE (S) t 



EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS) 

l: — (advanced) operational aariation fully developed 
(Piaget and Inhelder, 1974, 18S) 

—OTHER EARLY FORMAL OPERATIONAL (CONCRETE 
GENERAL I Z AT I ONS ) RESP0N8E ( S ) l 
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SORTING RECORD 1 of 5 



REVISED 



ACLIC INTERVIEW RECQRDt SORTING (About 20 minutes) 



NAMEJ 



BOY/GIRL GRADE t 



AtaEs 



BIRTHDAY! 



SCHOOL I 



INTERVIEWER: 



DATE i 



CASSETTE! 



COUNTER! 



MATERIALS I 



GRADE 1 



2 blank ahaatm of paper 

A mat of geomatric solids including! a sphere, a iarga 
cuba, a smaller cuba, a cona, a long narrow cylindar, a 
•h or tar wide cylindar, a long ractangular prism, a 
pyramid, a triangular pyramid, a long triangular prism 

Cardboard cutouts of three red squares, two blue squares 
and three blue circles. 



As for Grade 1, but with the addition of the following 

attribute blocks! 

a large, thin, blue circlet a small, thin, yellow 
circle? small, thin, red square i small, thin, blue 
triangle? large, thin, blue rectangle? large, thin, red 
triangle. 



CLASSIFICATION 

A. Mix the objects up and place them on a table before the 
child. Ask the child to put the objects into 2 groups so that the 
things in each group are alike in some way. All of the objects must 
be used. Have him place each group of objects onto a sheet of paper. 
After the child has sorted them ail, point to one of the groups and 
ask, "How are all the objects in this group alike? 



GROUP ONEj 



i i CORRECT i ] INCORRECT 



GROUP TW O! 



t i CORRECT i i INCORRECT 



GRADES 2 and 3 



PROCEDURE! 



GRADE 1 



O BEST COPY AVAILABLE 
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SORTING RECORD 2 of 3 



B. Mix tha objacta again and aak tha child to group thorn into 2 
groupa, a diffarant way. Whan ha haa finiahad aorting again aak, "How 
ara all tha oojocta in tnia group alika?" Than rapaat tha quaation 
-for tha aacond group. 

GROU P ONEi 



CORRECT ~ i • INCORRECT 



GROUP IWUl 



t t CORRECT i INCORRECT 



INCLUSION I 

Bring out tha rad and blua cardboard cutouta and /irranga tham in 
a iino (a.g., blua aquara f rad aquara, blua clrcla, rad aquara, blua 
aquara, blua circle, rad aquara, blua circlo) . Than aakt "What 
colour ia thia?" (pointing to one of tha tiguraa) "What ahapo ia 
that?" And than . . . 

"«ra all tha ctrciaa blua?" 

i ; Succaaa+ul « i Unauccaaa+ul 

COMMENT 8 l 



"Ara all tha Plus onoa circloa?" "Why?" 
i.< Succoaaf ul i i Unauccooatul 

COMMENT b I 
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SORTING RECORD 3 of 5 



GRADES 2 and 3 

Aa for Grada I, but rapaat tha CLASSIFICATION procadura uaing th« 
•at of attrxbuta blocka daacribad undar MATERIALS. 



CLASSIFICATION 
GROUP UNbJ 


< GEOMETRIC SHAPES) , 


A. 






■ CURRECT 


i i INCORRECT 






GROUP IWUt 










CURRECT 
CLASSIFICATION 
GROUP ONEt 


INCORRECT 
(GEOMETRIC SHAPES) , 


B. 






> ' CORRECT 


■ J INCORRECT 






GROUP fWOt 










' < CURRECT 
CLASSIFICATION 
GROUP ONE i 


i i INCORRECT 
(ATTRIBUTE BLOCKS) f 


A. 






i .1 CORRECT 


i i IMIORRECT 







GROUP TWO I 



i i CORRECT li INCORRECT 

CLASSIFICATION {ATTRIBUTE BLOCKS), B. 
GROUP ONE I 



i i CORRECT 



> i INCORRECT 



GROUP TWO i 



. i CORRECT 
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SORTING RECORD 4 of S 

INCLUSION 

•'Are all the circln blue?" 
' Succeaa+ul < i Uneucceaaf ul 

COMMENTS l 

"Ant all the blue onaa circlea?" "Why?" 
Succaaaf ul < i unaucceaaf ul 

COMMENT b I 

IDENTIFICATION OF COGNITIVE LEVEL OF RESPONSE 
CLASSIFICATION 
PREOPERATIONAL. 

< i Abla to aort objacta but inconaiatant in naming an 
attribute common to all tha objacta in a group. 

Incapabla of conaidering an antira group of objacta 
aimultanaoualy and of naming a aingla comm on attribute. 

OTHER PREOPERATIONAL RESPONSE / COMMENT'S l 

EARLY CONCRETE OPERATIONAL. 

Abla to group the objacta in only one or two way a. 
wnan tha objacta ara mix ad up again , unable to aort them into 2 
different groupa, on requeat. 

• • OTHER EARLY CONCRETE OPERATIONAL RESPONSE/COMMENTS t 

LATE CONCRETE OPERATIONAL. 

Hi The child'a thinking ia flexible. 

i i OTHER LATE CONCRETE OPERATIONAL RESPONSE /COMMENTS I 
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INCLUSION 

PREOPERATIONAL. 

Only knows what is "seen". ". . . cannot mentally 
sioaratt tne circles am a class from the whola sarias. All' can only 
ffi*an . . . tha whole of tna graphic collaction" (Copeland, 1974b, 39). 

OTHER PREOPERATIONAL RESPONSE/COMMENTS: 



EARLY CONCRETE OPERATIONAL 

Successfully dissociatas squares as a class from 
circles and red from bluas, but not yat abla to sat up classas basad 
on tha logic at inclusion. 

Response to "Are all the circles blue?"t "Wo, 
because there are blue squares." Since the child does not yet have 
the logical structure required to answer the question "Are all of the 
circles some ot the blues?" the question is interpreted "Are all the 
circles all the blues?" 

OTHER EARLY CONCRETE OPERATIONAL RESPONSE /COMMENTS t 



LATE CONCRETE OPERATIONAL. 

Child can establish logical classes of "circles," 
"squares," and "blues," considering the entire heterogenous grouping 
"all" of the shapes, and the circles as "some" of the shapes which are 
blua. (Copal and, 1974b, 39, 40) 

OTHER LATE CONCRETE OPERATIONAL RE8P0N8E/C0MMENTS t 



BEST COPY AVAILABLE 

o 

ERIC 



159 

142 



DOT RECORD 1 of 2 
ACLIC INTERVIEW RECORD! DOT (About IS minutes) 
NAMEt BOY /GIRL GRADE: 



AGE! BIRTHDAY i SCHOOL: 



I NTE RV I EW ER: D ATE: CASSETTE: COUNTER: 

MATERIALS: sheets of plain white rectangular paper, a thirty 

centimetre ruler (marked in cm only), an unmarked stick, 
strips of paper, lengths of string. 

PROCEDURES! Give the child two identical sheets of plain 

white rectangular paper, placing them at opposite corners 
of the table, as shown below. On one of the sheets mark a 
point, Pi, in red about halfway titween the centre of 
the rectangle and its upper right-hand corner. Ask the 
child to mark a point on the second sheet in the same 
position as Pi has on the first sheet ... so that 
if the second sheet is o laced on top of the first, the two 
points will be in the same place. 



I 

.Pi I 



COGNITIVE LEVELS OF RESPONSE 

PREOPERATIONAL! 

C Children make no use whatever of the material provided. 
Instead of attempting to measure, they place their point by visual 
estimate. 

u OTHER PREOPERATIONAL RE8PON8E1 
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DOT RECORD 2 of 2 

EARLY CONCRETE OPERATIONAL: 

The point is located vieually. Meaeuring da /ices are 
used perceptually and inappropriately. 

Beginnings of meaaurement - howavar, meaaurement is 
one-dimenaional . Obliqua maaauramant ia common -from a cornar o-f tha 
rac tangle. 

OTHER EARLY CONCRETE OPERATIONAL RESPONSE: 



LATE CONCRETE OPERATIONAL: 

Empirical diacovery of two-dimensional maaauramant. 
(Trial -and-error) . 

OTHER LATE CONCRETE OPERATIONAL RESPONSE: 



EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS) 

T. Thare is no trial -and- error behavior! the child 
immediately coordinatea tha two rectangular meaaurementa. 

" OTHER EARLY FORMAL OPERATIONAL RESPONSE (CONCRETE 
GENERALIZATION) 3 
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LOCI RECORD 1 of 2 

REVISED 

ACLIC INTERVIEW RECORD i LOCI (About IS minutes) 

NAM El BOY/GIRL GRADE t 

AGE i BIRTHDAY l SCHOOL t 

INIER V I EWERi DATEi CASSETTE! COUNTER! 



MATERIALS i a set of beads, ruler, pencil, sheets of paper, felt pen 

PROCEDURE 1 

TASK 1 i Begin with a blank sheet of paper. As the child watches, 
mark two points on the sheet, saying, "Let's imagine that this is a 
tree, and this is another tree. " (The points should not be centred on 
the sheet.) "Where can you stand so as to be the same distance (or 

just as far ) from either tree? 11 (Ask the child to indicate the 
position with a bead.) "Are there any other points? 11 After the 
questions have been answered in this fore, remove bead(s) froe paper 
and ask the child to draw all possible positions. If the child says 
that the beads are on a line, ask whether the points can touch, and 
how far the line can go. 

TASK 2 1 The Driblet* is extended to cover equidistance from several 

points A and A*, B and B% etc., where points A, B, C and D lie 

in a straight line, and points A* , B 1 , C 1 and D* lie 

at corresponding distances in another line at right angles to it. 

(The locus of points equidistant froe A and A 1 , etc. is then the 

bisector of the angle.) 

As the child watches, m*rk the points on the sheet, saying, 
"This is a row of trees and here is another row of trees. Where can 
you stand so as to be the same distance froe (or just as far) from 
either row?" 




TASK 3 i A single dot is marked on a sheet of paper. Ask the child 
to show where a set of beade should be placed, or where a series of 
trees should stand, in order to be the same distance, or "just as 
far", from the dot. 

BEST COPY AVAILABLE m 
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LOCI RECORD 2 of 2 

IDENTIFICATION OF COGNITIVE LEVEL OF RESPONSE 

PREO°ERAT I ONAL . 

Task i. The child indicittt a point at random without 
regard for distance* involved. 

Task 2. 
Task 3. 

COMMENTS l 



EARLY CONCRETE OPERATIONAL. 

Task li The child finds one solution, the midpoint 

estimated perceptually, but fairly accurately, 
or a fen other points nearby. 

< i Task 2 i The child only considers two of the points or 

produces irregular and random intervals 
between various points. 

i i Task 3t The child arranges the beads either in a row or 

else in an irregular ring around the point without any 
attempt to measure (without discovering for each point 
the point which is symmetrical to it in relation to 
the centre) . 

COMMENTS! 



LATE CONCRETE OPERATIONAL. 

■ t Task 1. The child shows an inkling of the "locus" but 

this is achieved by extending the method used in 

i » Task 2. placing the first (central bead) and placing one 

bead behind another in a continuous line 

u Task 3. following the same direction. There are 

occasional errors in equidistance and these due to 
over emphasis on continuing in a chosen direction, to 
the neglect of a careful return to the p >nt of 
departure, i.e., no thought is given to symmetry. 

COMMENTS I 



EARLY FORMAL OPERATIONAL (CONCRETE GENERALIZATIONS) . 



» j 



Task 1. The most important achievement at this stage is 

reasoning by recurrence. The child determines a few 
Task 2. points in the series ant* immediately conclude* 

that all points on the circle or straight line must 
Task 3. have the same property. 



COMMENTS! 
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BEADS RECORD 1 of 2 



NAME: 



AGE i 



INTERVIEWER: 



ACLIC INTERVIEW RECORD i BEADS (About 15 minutes) 
Linear and Circular Order (Piaget, 1956, 80-103) 
BOY/GIRL GRADE i 



BIRTHDAY* 



SCHOOLS 



DATEi 



CASSETTES 



COUNTER; 



MATERIALS: 



PROCEDURES: 



TASK 1: 



a string of nine var i -coloured beads arranged in a circle 
a string of nine van-coloured beads arranged in a simpla 
1 i near order 

a string of twelve var i -coloured beads arranged in a 

figure 8 pattern 
lengths of string, loose var i -coloured beads 



Transposition of circular into simple linear order 
making the linear order correspond to beads arranged in a 
circular loop. "What would the necklace look like if it wen 
in a straight line?" 



Successful 

COMMENTS: 



Unsuccessful 



TASK 2s Establishment of reverse order. Show the child a set of 

beads arranged in a row. Ask the child to arrange his own row 
of beads in the reverse order to that shown. (Can you start 
from the other end?) 



Successful 

COMMENTS: 



Unsuccessful 



TASK 3s 



Transposition of a figure 8 pattern into linear order. 
Reproducing a string of beadn arranged in a figure 8 pattern f 
in simple linear order. 



j Successful 

COMMENTS s 



Li 



Unsuccessful 
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BEADS RECORD 2 of 2 



COGNITIVE LEVEL OF RESPONSES 

PREOPERATIONAL. 

Unable to make another row o-f beads in the mama order. 
May arranga 2 baads in ordar correctly but unable to coordinate the wholi 
sequence of beads into a given simple linear order. 

OTHER PREOPERATIONAL RESPONSE: 



EARLY CONCRETE OPERATIONAL. 

Unable to transpose the circular order to a linear order 
and unable to make a row in reverse order. Toward the end o-f the EARLY 
CONCRETE OPERATIONAL Period a child may be able to reverse the order, but 
it is a trial -and-error process (Often loses track after centre of row, 
making the last half a copy of the modal instead of its reverse). 

0 HER EARLY CONCRETE OPERATIONAL RESPONSEi 



LATE CONCRETE OPERATIONAL. 

Solves the problems quickly and with ease. Can reverse 
the order and correctly consider the intertwining relationship that exists 
in the figure 8 form. 

OTHER LATE CONCRETE OPERATIONAL RESPONSEi 
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Cognitive Demand Level Criteria 



BEST COPY AVAILABLE 1U0 

er|c 9 16 « 



ACLIC Cognitive Demand Criteria, Numeration 



Pre-operation al (PO) 

Counts to 10 but unable to conserve number because of perceptual distractions 

or inability to use transitive logic with numbers 
Constructs a serial correspondence between two sets of ten objects graded in 

size in a regular manner 
Experiences difficulty dividing a region into two equal parts (halves) 



Early Concrete Operational (EC) 

Constructs, represents, and identifies equivalent sets but can be fooled by 

perceptual distr actors 
Constructs and recognizes simple patterns using concrete objects or their 

images 
Conserves number 

Recognizes simple properties and relations in concrete materials 

Uses one-way classification, forms simple hierarchies, and orders objects or 

th^ir images using one major attribute 
Can establish a serial correspondence between two sets of objects that are 

graded in size but may be confused when either series is reversed 
Does not use cardination systematically 

Able to perform composition of numbers intuitively with dependence on 

perceptual content and with lack of reversibility 
Can construct a two- or three-digit nunber with base-ten blocks and can read 

the associated numerals 
Can interpret simple fractions only in concrete and specific cases 
Can divide a region (or set) into two equal parts but does not realize that 

the whole is necessarily the sum of its parts 



eric 



Late Concrete Operational (LC) 

Classifies data successfully, consistently 
Exhibits reversibile thinking with concrete data 
Recognizes relationships between things visibly or tangibly present 
Uses the concepts of number conservation, transitivity, and reversibility in 
concrete contexts 

Uses the logic of classes, differences, and relationships in direct or 

vicarious experiences 
Generalizes the special properties of 0 and 1 

Is aware of reversibility in the classification and seriation of objects or 

their images taking into account two major attributes 
Seriates two sets of size-graded objects, or numbers, and co-ordinates the 

relevant ordinal- and cardinal numbers 
Uses an operational concept of numerical equivalence which is no longer 

subverted by perception 
Consistently identifies the number "2 less than" any given one-, two-, or 
three-digit number 

Makes three equal parts intuitively, grasping the concept of conservation of 

the whole 
Rounds to the nearest hundred 

o 150 167 " ' 



Identifies one-half, one-third, one-quarter, one-fifth, or one-tenth of a 
shaded figure 



Early Formal Operational (EF) 

Sees x, as a "rain check," as a generalized number, b^t with the idea that 
sooner or later it must be translated to a particular number 

Generalizations from concrete experience are made but are only usable within 
the context of that concrete experience 

Generalizes concrete patterns 

Copes with formal structures only in concrete embodiments 
Handles abstract ratio and rate concepts provided that they are related to 
concrete situations 

Subdivides a given whole into thirds, fourths, fifths, or sixths by means of 
an anticipatory schema (i.e., an a priori understanding of the relations 
between the fractions sought and The original whole); operational 
conservation of the whole is understood 

Systematically handles and/or explains three-digit subtractions witn 
regrouping over a zero digit 

Finds missing terms in ratios involving multiples greater than four, or terms 
that are two-digit or larger 

Locates points on a nimber line to the nearest hundredth 



Formal Operational (F) 

Uses purely abstract thought; is able to combine novel results beyond 
personal experience 

Hypothesizes about possible conclusions from theory, designing experiments to 

test those hypotheses 
Handles formal structures in which the elements are abstract, including 

manipulations with large numbers where successive steps necessitate delay 

of arithmetic closure 
Considers familiar rules and relationships as part of reality, capable of 

being operated on to produce all of the logical transformations 
Is able to select appropriate transformations for particular relationships (as 

in real problem solving) implying a systematic overview, whether this is 

based on mathematical conventions or arises out of physical reality 
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ACLIC Cognitive Demand Criteria, Operations 



Pre-operational (PO) 

Handles "commutativity" and "multiplication by 1" intuitively and perceptually 
[Counts from 1 to 10] 



E arly Concrete Operational (EC) 

Resists premature closure fas in 213 + 342 = 342 + []) 

Knows and uses Basic Facts of arithmetic operations (+, -, x, *) 

Performs addition, subtraction, multiplication, and division on multidigit 

numbers without regrouping 
Handles three addends without regrouping 

Demonstrates understanding of qualitative compensation with nunbers but 

quantitative accuracy inconsistent 
Generalizes one-step patterns from the concrete (e.g., commutative and 

associative properties of addition) 

Late Concrete Operational (LC) 

Uses two or more steps or operations (e.g., x distributed over +) 
Generalizes procedures from the concrete 
Multiplies by 0 

Performs addition, subtraction, multiplication, and division on multidigit 

nunbers with regrouping (multidigit by one-digit division) 
Uses multiple addends with regrouping (i. e., sums > 18) 
Employs accurate quantitative compensation with nunbers 
Successfully relates two or more facts systematically 
Interprets simple story problems 

Early Formal Operational (EF) 

Handles multidigit subtraction with borrowing across zero 
Explains and uses multidigit computational algorithms successfully 
Computes with multidigit multipliers containing zeros 
Divides with quotients containing zeros 
Multiplies by 10, 100, . . . 

Uses "primitive placeholders 11 (e. g., "x as a raincheck") 
Constructs abstract, propositional thinking from concrete elements 

Formal Operational (F) 

Successfully operates on relatively large numbers with systematic persistence 

over successive steps (e.g., (800 + 25) + 10 r [] + (25 + 10) 
Successfully uses formal structures with abstract elements (e.g., 
f-e=[]-f) 
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ACLIC Cognitive Demand Criteria, Measurement 



Pre-operational (PO) 

Judges length by perception only, with endpoints considered in isolation 
Is unable to apply the concept of equal distances between points 
Believes that time passes more or less rapidly according to the speed of work 
being timed 

Cannot identify heaviest, middle, and lightest weights given three objects and 
a balance; may compare weights two at a time but does not attempt to 
coordinate two comparisons 

Early Concrete Operational (EC) 

Deals with measurement of length or width but is unable to coordinate the two 

to make judgements about area 
Uses concepts of measurement meaningfully only in concrete and specific cases 
Recognizes simple properties and relations through practical manipulations of 

materials 

Uses one-way classification, forms simple hierarchies, and orders on the basis 

of a major attribute 
Cannot ascribe a unique unit of time or a common duration to motions at 

different velocities 
Can estimate perceptually, and fairly accurately, the midpoint between two 

given points as well as a few other points equidistant from the given 

points 

Can use beginning notions of one-dimensional measurement 
Seriates weights empirically but is unable to use transitive inference 
Conserves area and compares areas by counting units (visjal iteration of area 
units) 

Estimates length using metric units 

Chooses an approp iate unit of length with which to measure an object 
Conserves length and uses multiple steps in comparing lengths 
Conserves volune (capacity) using numerical data, overcoming perceptual 

interference and recognizing that volume \s independent of shape 
Conserves quantity 

Uses transitive inference to compare capacities 
Late Concrete Operational (LC) 

Uses inductive and deductive logic but only in concrete situations 
Classifies data 

Thinks systematically in concrete situations, relating two or more facts but 

not making extensions or generalizations 
Thinks reversibly with concrete data 
Successfully uses measurement systems in one dimension 

Two- and three-dimensional measurement is handled only in concrete situations 
Recognizes area and speed informally but not in terms of products and ratios 

of component dimensions 
Uses reversibility of classification and seriation involving two major 

attributes of objects 
Uses measuring tools placed along objects to be compared and uses transitivity 
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to make inferences about their lengths 
Predicts that a task done more quickly will take less time but estimates 

(guesses) inaccurately, even when it is possible to calculate time elapsed 

from giver, information 
Discovers two-dimensional measurement empirically (Trial-and-error) 
Seriates weights operationally 

Identifies the heaviest, middle and lightest of three given objects by 

co-ordinating all the relations 
Orders as many as 10 objects from lightest to heaviest 
Is unable to coordinate inverse relations (e.g., heavier and lighter than) 
Makes a series of length comparisons using the transitive property 
Compares areas by transformation of visual units and counting (unit iteration 

and coordination of multiple conditions) 

Early Formal Operational (EF) 

Uses fairly advanced inductive and deductive logic at a relatively abstract 

level but with dependence on the concrete elements in the situation 
Attempts abstract and propositional thinking, but with limited success 
Goes outside known data to form hypotheses, but with limited success 
Predicts accurately the time taken by a task done twice as quickly as a 

referent task, having assembled the necessary data 
Seriates weight and uses inverse relations 

Mentally visualizes the integration of a nunber of units of measure (e.g., 

area, volume, . . .) 
Conserves area and compares by counting units, where units are not visible, by 

mental iteration of units 
Transforms non-square units of area 

Visualizes the number of cubic units in an irregular shape 



Formal Operational (F) 

Uses hypothetical and deductive thinking 

Uses data in terms of propositions to be tested out in thought 

Thinks logically in symbolic and abstract form 

Can begin with theory rather than with evidence 

Reasons by implication at an abstract level 

Uses formal structures with abstract elements 

Uses proportionality and reciprocity fully 

Considers all combinations of factors or relations in a theoretical or closed 
system 
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ACLIC Cognitive Demand Criteria: Geometry and Graphing 



Pre-operational (PO) 

Uses intuitive and transductive thinking 
Thinking is related to the situation at hand 
Focuses on only one feature at a time 
Has an egocentric view of the world 

Sorts objects but is inconsistent in naming common attribute(s) of each set 
Locates a point on a sheet of paper similar to the model shown by using visual 
estimates only 



Early Concrete Operational (EC) 

Attempts inductive and deductive logic with limited success 
Attempts to use reversibility, unsuccessfully 

Identifies simple properties and relations in concrete objects only 

Uses one-way classification, forms simple hierarchies, and orders on the basis 

of one major attribute 
Dissociates squares from circles and reds from blues, for example, but is 

unable to handle class inclusion 
Classifies (sores) objects in one or two ways but is unable to dichotomize 

using negation 

Can replicate the order of a set of objects but is unable to make the series 

in reverse or circular order 
Relying completely on perception, finds only one point equidistant from two 

given points, the midpoint; chooses other points at random 
When locating points equidistant fVom a given point, locations are chosen 

without measuring and in a row or an irregular ring * 
Locates a point on a sheet of paper similar to the model shown by using visual 

estimation or inappropriate measuring procedures, usually in one dimension 



Late Concrete Operational (LC) 

Uses inductive and deductive logic in concrete situations 
Classifies data 

Relates two or more facts without generalizing 

Coordinates and uses several relevant attributes (e.g., length and width) 
Uses conservation and transitivity of length 

Generalizes symmetrical properties but not beyond a specific case 
Uses compensatory manipulations 

Concepts of one-dimensional space are well established but two- and 

three-dimensional ideas are limited to the concrete 
Uses reversibility of classification and seriation, taking into account two 

major attributes of the objects being considered 
Uses logical classes, e.g., "circles, 11 "squares, 11 and "blues, 11 and interprets 

"all 11 and "some" appropriately 
Classifies objects in several ways 

Systematically reverses the order of objects in a row, a circle, or an 

intertwined arrangement 
Locates a number of points equidistant from two points or from one point, 
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without using symmetry 
Locates a point on a sheet similar to the model shown, using trial-and-error 
two-dimensional measurements 



Early Formal Operational (EF) 

Uses relatively more advanced inductive and deductive logic 
Attempts abstract and pro positional thinking, with limited success 
Uses abstract ratio and rate concepts but only in the context of concrete 
situations 

Uses graphical relations, including non-linear ones, and spatial 

transformations but with limited success unless they are related to 
concrete situations 

Handles loci by reasoning by recurrence 

Immediately locates a point on a sheet of paper similar to the model shown by 
using coordinated rectangular measurements 

Formal Operational (F) 

Uses hypothetical and deductive logic 
Reasons by implication at an abstract level 

Selects appropriate transformations for particular relationships 

Uses abstr3ct and proportional reasoning 

Uses abstract ratio, rate, graphical, and spatial relations 
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Appendix 3; 

Students' Performance on Items from Provincial Achievement Tests 
Included in ACLIC Paper and Pencil Tests. 
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^able A3* 1 ♦ Students' Performance on Items from Grade 3 Provincial 
Achievement Test Included in ACLIC Grade 3/4 Tests. 



ACLIC 


Item Number 


Item 


Difficulty 


Significance 


Grade VU 


ACLIC 


Ach. 


Ach. 


ACLIC 


ACLIC 


of Difference* 


Test 


lest 


lest 


Gr 3 


ur $ 


or 4 


ur i 


ur 4 


Number 


1 


3 


0.70 


U. Oi 


r\ to 
U. f<; 


ns 


ns 




2 


10 


0.57 


0.57 


0.69 


ns 


+ 


N=l 15 (Gr3) 


3 


15 


0.5U 


0.62 


0.52 


ns 


ns 


N=9U (GrU) 


U 


1U 


0.U8 


0.37 


0.U6 




ns 




5 


17 


U . 44 


0.U1 


0.38 


ns 


ns 


Operations 


21 


33 


0.5U 


0. 57 




ns 


+ 




22 


3U 


0.77 


0.39 


0.81 




ns 


N=9U (Gr3) 


23 


35 


0.86 


0.39 


0.91 




ns 


N=100 (GrU) 


2U 


36 


0.89 


0.60 


0.87 




ns 




25 


37 


0.91 


0.79 


0.89 




ns 


Geom/Graph 


26 


20 


0.U8 


0.U3 


0.54 


ns 


ns 




<X 


21 


O.UU 


O.UU 


0.56 


ns 


+ 


N=1 12 (Gr3) 


28 


23 


0.80 


0.76 


0.77 


ns 


ns 


N= 90 (GrU) 


29 


25 


0.62 


0.25 


0.31 








30 


2U 


0.66 


0.37 


0.28 







* n s = Chi-squared goodness of fit test with df=1 indicated that the 

observed Derformance on the item was not significantly different 
(p=0.05) from that predicted by the p-value of the item 
for the provincial sample. 

+ = ACLIC sample performed significantly better (p<0.05) than predicted. 

- = ACLIC sample performed significantly worse (p<0.05) than predicted. 
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Table A3. 2: Students' Performance on Items from Grade 6 Provincial 
Achievement Test Included in ACLIC Grade 5/6 Tests. 



ACLIC 


Item Number 


Item Difficulty 


Significance 


Grade 5/6 


ACLIC 


Ach. 


Ach. 


ACLIC 


ACLIC 


of difference* 


Test 


Test 


Test 


Gr 6 


Gr 5 


Gr 6 


Ur d 


Or 0 


Number 


1 


1 


0.67 


0.57 


0.72 


mm 


ns 




2 


2 


0.53 


0.61 


0.52 


ns 


ns 


N=92 (Gr5) 


3 


3 


0.54 


0.58 


0.34 


ns 




N=90 C^ro; 


4 


4 


0.53 


0.37 


0.49 




ns 




c 

b 


•7 

1 


u. t>y 




n no 


- 


ns 




6 


10 


0.59 


0.41 


0.62 




ns 




7 


11 


0.59 


0.37 


0.50 


- 


ns 




8 


12 


0.87 


0.85 


0.80 


ns 


- 




15 


8 


0.35 


0.17 


0.14 


- 


- 


Operations 


"2 1 


1 0 


U. fU 




fi 7c; 
U. (D 


- 


ns 


N*94 (Gr5) 


32 


22 


0.63 


0.43 


0.68 




ns 


N=92 (Gr6) 


33 


26 


0.54 


0.33 


0.58 


- 


+ 


neasuremenu 




44 


0.59 


0.29 


0.34 








32 


45 


0.67 


0.31 


0.51 






N=139 (Gr5) 


33 


30 


0.60 


0.48 


0.65 




ns 


N=1 13 (Gr6) 


34 


29 


0.4U 


0.24 


0.33 








35 


32 


0.65 


0.37 


0.62 




ns 


Geom/Graph 


32 


4U 


0.59 


0.13 


0.22 








33 


36 


0.63 


0.42 


0.62 




ns 


N=151 (Gr5) 


34 


37 


0.55 


0.23 


0.43 






N= 94 (Gr6) 


35 


40 


0.61 


0.34 


0.41 







* n s = Chi-squared goodness of fit test with df=1 indicated that the 

observed performance on the item was not significantly different 
(p=0.05) from that predicted by the p-value of the item 
for the provincial sample. 

+ r ACLIC sample performed significantly better (p<0.05) than predicted ♦ 

- = ACLIC sample performed significantly worse (p<0.05) than predicted. 
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urauc 1 wurncrai/ion ourann uujcci/ives 


on 
rU 


to 


f r* 
IX 


CT7 

tr 


t7 

r 


111 


Matches members of two sets and determines equivalent and non-equivalent sets. 




1 








1 1 o 


Describes nimber relationships: more, fewer, greater than, less than, and equal 
to (no symbols). 




1 








1.1.3 


Associates a mineral with equivalent sets (0-10). 


1 










1.1.4 


Orders numbers 0-10. 






1 






1 1 R 


nedUo q. wriues numerals ^u— iuuj. 




1 








1 1 A 


identities the number of 10's ana the number of rs in any two-digit nunber. 




1 










r-vz-i /-s I Mi wham 4* i am 04* w mm/4 4* nl 

uraae i Numerauion ouranc iouai 


m 


66% 


1 

17% 


0 

0% 


0 

0% 




Grade 2 Numeration Strand Objectives 


PO 


EC 


LC 


EF 


F 


2.1.1 


Identifies the cardinal nunber associated with a set of objects. 




1 








2.1.2 


Orders nunbers and recognizes "betweenness 11 (0-100). 






1 






2.1.3 


Reads and writes minerals (0-999). 




1 








2.1. 4 


Names and uses ordinals first to tenth. 






1 








Identifies the nunber of 100's, 10's, and 1 ! s in a given three-digit nuneral. 




1 









2.1.6 


Identifies multiples by counting by 5*s, 10's, and 100's. 




2 


1 






2.1.7 


Identifies, represents, and writes proper fractions (halves, thirds, and 
quarters) in a concrete and pictorial setting. 






1 




0 

0% 




Grade 2 Numeration Strand Total 


0 

0% 


5 
56% 


4 


0 

0% 



BEST COPY AVAILABLE 



(SI 



ERIC 





Grade 3 Numeration Strand Objectives 


P0 


EC 


LC 


EF 


F 


3.1.1 


Orders and determines "betweenness" of whole numbers (0-1 000) and understands 

ojfiuwio /j \j dllU — \AJ olKJW rcldtlUridiUpd* 






1 






3 1-2 


RprVi^ anrt ur*i1"OQ ni mop al c f fi—Q QQQ^ 




1 
1 










Tdpnti fi mill nl ps hv nnnnlHnff hv P f s Ric ifitc pf^tc ?anri mote 1 nnr^ 




d 


3 






3.1.1 


Identifies the number of 1 000 f s, 100 f s, 10 f s, and Vs in a nunber. 




1 








3.1.5 


Writes numbers in expanded notation (0-1 000) and vice versa. 




1 








3.1.6 


Identifies, writes, and compares proper fractions from concrete and pictorial 
representation (halves, thirds, quarters, fifths, and tenths). 






1 






3.1.7 


Reads and writes decimals from concrete and pictorial situations (tenths only). 






1 








Grade 3 Numeration Strand Total 


0 

0% 


5 
45% 


6 

IT IT* 

55% 


0 

not 

0% 


0 

0% 




ui due h nuiiicrduxun our ana UDjecuives 


P0 


EC 


LC 


EF 


F 


U 1 1 


nounas wnoie nunDers ^ limit t to trie nearest tnousanct; . 






1 






4.1.2 


Writes whole nimbers in expanded notation and vice versa. 






1 












l 








2i 1 U 


Identifies, reads, and writes a fraction to represent a point on a nunber 
line, a part of a region, or a part of a set (emphasis on halves, thirds, 
quarters, iiitns, and tenths;. 






1 








laenunieb equivalent tractions. 









1 




4.1.6 


Reads, writes, and orders whole numbers anu decimals (0.01 - 99 999). 






1 


1 




1.1.7 


Regroups tenths and hundredths. 








1 






Grs.de 4 Numeration Strand Total 

183 


0 

0? 


2 

18% 


6 

55% 


3 
27% 


0 

°V 
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Grade 5 Numeration Strand Objectives 


| P0 


EC 


LC 


EF 


F 


5-1.1 


Identifies anH namp<; r>lar»p val up ftf diffits (0 001 — QQQ QQQ v j 




i 
i 


p 






5 1 2 


nuuiiuo wnuic nurriucr o v. lxiiiiu* uric? ncarcot uen unouoancu . 






i 
i 






5 1 3 














5.1.4 


Expresses and generates proportional ratios. 









..... 




5.1.5 


Solves for the missing mineral in proportional ratios without using cross 

— nroduots 












5.1.6 


Expresses tenths, hundredths, and thousandths as fractions or decimals. 








L , 




5.1.7 


Generates equivalent fractions for halves, quarters, fifths, tenths, and 












5. 1.8 


It^&l wupo IsdllaJD, lJUllUl tr . Ulc , dllU UlUUOdllu ^llOc 








- 




5.1.9 


Reads, writes, and orders whole nunbers and decimals (0.001 - 999 999) 




1 


1 


1 






Grade 5 Numeration Strand Total 


0 


2 

lb* 


4 


7 


0 

0% 




\ji auc u iiuiiierduifii our ana m/jecuives 


DA 

rU 


LC 


LC 




r* 

r 


6. 1 . 1 


luciiuiiico diiu ndnieo pidce vdiuc xaj Diiiions vu.uuui — i uuu uuu uuu/. 




1 








6 1 2 

V • l m Cm 


hi iuco ucv^xiiidj. nuTiGra±o uoing cxpdnutxi nouauion . 













6.1.3 


Rounds nunbers £0 0001 to QQQ QQQ QQQ^ 






i 
i 






6 1 U 


TH on 4" i f 1 DC anH nene rM"/^ TYM" 4* ^ f\m ol r^f i* 

luciiL/ii ico diiu uoco propor oion di rai*iOo. 












6.1.5 


Expresses halves, quarters, and fifths as fractions or decimals. 












6.1.6 


Expresses fractions and decimals as percents and vice versa. 
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6.1.7 


Identifies and orders integers. 






1 


1 




6.1.8 


Reads, writes, and orders whole numbers and decimals (0.0001 - 
1 000 000 000) . 




i 
i 


1 
I 


1 
I 






Grade 6 Numeration Strand Total 


0 

0% 


2 

m 


5 

36? 


7 

50% 


0 

0% 






PO 


EC 


LC 


EF 


F 



ON 

—3 
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Grade 1 Operations and Properties Objectives 


PO 


EC 


LC 


EF 


F 


1.2.1 Understands the process of addition and subtraction. 




2 








1.2.2 Svmbol i 7PS addltMnn and ^intrant*"! r\r\ ci f , naf"i r*nc 

1.2.^ Demonstrates mastprv of ha.sio rant**; involving sums and mlnnpnd^ t*hrrmi7h Q 




c 


o 
d 




■- - 


Gradp 1 Onprations and Pronf*rtips ^frand Tribal 


n 
u 

0% 


n 

67% 


2 

33% 


a 
u 

0% 


u 

0% 


Grade 2 Operations and Properties Objectives 


PO 


EC 


LC 


EF 


F 


2.2.1 Symbolizes addition and subtraction situations. 






2 






2.2.2 Understands the basis of the commutative property for addition. 




1 








2.2.3 Understands the processes of multiplication and division. 




2 








2.2.4 Demonstrates masterv of basic facf*; involvinff ^um<* and mlmuanriQ 1fl 




c 








2.2*5 Adds and subtracts to QQ without rpffronninff 




o 

c. 








Grade 2 ODer at ions and Prooprtips rand Tnfal 


n 
u 

0% 




2 
22% 


u 

0% 


u 

0% 


Grade 3 Operations and Properties Objectives 


PO 


EC 


LC 


EF 


r? 


3.2.1 Identifies addition, subtraction, multiplication, and division situations. 






4 






3.2.2 Adds and subtracts two- or three-digit nunbers with and without regrouping. 




2 


2 


1 




3.2.3 Symbolizes multiplical . n and division situations. 






2 






3.2.4 Understands the commutative property of addition and of multiplication. 




2 








3.2.5 Identifies related sentences for addition, subtraction, multiplication, and 
division. 






4 







3.2.6 


Understands the unique effect of 0 and 1 in addition and multiplication. 




J 


i 
i 






3.2.7 


Demonstrates mastery of basic facts involvinc sums and minuends Kr» 1ft and 
products and dividends to 45. 




II 
4 








3.2.8 


Multiplies whole nunbers bv 10 and 100 








1 






Grade 3 Operations and Properties Strand Total 


U 

0% 


1 1 

42% 


13 
50% 


2 

8% 


0 

0% 




Grade 4 Operations and Properties Objectives 


P0 


EC 


LC 

2 


EF 
1 


F 


4.2. 1 


Adds and subtracts numbers using standard and expanded notation. 




2 


4.2.2 


Multiplies whole nunbers bv one— and tun— dlfflt* uhnlp mmhpr^ 






1 


1 




4.2.3 


Writes related sentences for addition, subtraction multiDlication and 
division. 






Jl 






4.2.4 


Understands the associative property of addition and of multiDlipaH nn 






2 






4.2.5 


Demonstrates mastery of basic facts for suns and minuends to 18 and products 
and dividends through 81. 




4 








4.2.6 


Divides one- and two— dicit whole numbers bv a nnA-rH a it- rHvi^nr ftrifs onrt 
without remainders). Estimates quotients. 







2 




4.2.7 


Multiplies whole nunbers by 10, 100, and 1000. 








1 




4.2.8 


Adds and subtracts decimals to hundredths. 






2 








Grade 4 Operations and Properties Strand Total 


0 
0 


6 

26% 


12 
52% 


5 
22% 

l 


0 

0% 



191 



192 





Grade 5 Operations and Properties Objectives 


P0 


EC 


LC 


EF 


F 


5.2.1 


Adds and subtracts whole nunbers. Estimates sums and differences. 




2 


2 


3 




5.2.2 


Demonstrates mastery of basic facts. 












5-2,3 


Multiplies whole nunbers using one-, two-, and three-digit multipliers. 
Estimates products. 






1 


2 




5.2.4 


Divides whole nunbers using one- and two-digit divisors (with and without 
remainders). Estimates quotients. 






1 


3 




5.2.5 


Multiplies and divides whole nunbers and decimals by 10, 100, and 1000. 








2 




5.2.6 


Adds, subtracts, and multiplies decimals (suns, differences, and products to 
thousandths) . 






2 


I 




5.2.7 


Divides decimals by one-digit whole nunbers. 






4 

1 


1 






Grade 5 Operations and Properties Strand Total 


0 

0% 


6 
2U% 


7 

28% 


12 
48% 


0 

0% 




Grade 6 Operations and Properties Objectives 


PO 


EC 


LC 


EF 


F 


6.2.1 


Adds and subtracts whole numbers and decimals. Estimates sums and differences. 




2 


2 


3 





6.2.2 


Demonstrates mastery of basic facts. 




li 








6.2.3 


Multiplies whole numbers and decimals using one-, two-, and three-digit 
multipliers. Estimates products. 






1 


3 




6.2.4 


Divides whole nunbers and decimals using one-, two-, and three-digit when 
number divisors. 






4 

1 


2 




6.2.5 


Divides whole numbers and decimals using one decimal place divisors. 










1 


6.2.6 


Checks multiplication by division and division by multiplication. 








2 




6.2.7 


Mentally computes simple addition, subtraction, multiplication, and division. 




1 


1 







6.2.6 


Calculates averages and percentages. 








1 

1 


1 
I 




Grade 6 Operations and Properties Strand Total 


0 

0% 
PO 


7 

28% 
EC 


5 
20% 
LC 


11 

uu% 

EF 


2 

8% 
F 



195 



196 





Grade One Measurement Objectives 


PO 


EC 


LC 


EF 


F 


1.3.1 


Tells time to the hour. 




1 








1.3.2 


Recites and orders the days of the week. 


1 


1 








1.3.3 


Compares two or more objects as shorter, longer, thinner, thicker, heavier, 
and lighter than. 




2 


1 






1.3.4 


Estimates, and measures using non-standard units of length, capacity, and mass. 




1 


5 






1.3.5 


Identifies instrtments for measuring length, capacity, mass, time, and 
temperature. 


3 


2 








1.3.6 


Recognizes pennies, nickels, d: ->es ? and quarters and states the value of each. 


1 


1 










Grade 1 Measurement Strand Total 


5 

26% 


8 

42% 


6 

32% 


0 

0% 


0 

0% 




Grade TV/o Measurement Objectives 


PO 


EC 


LC 


EF 


F 


2.3.1 


Tells time to the hour, half hour, and quarter hour. 




1 


2 






2.3.2 


Writes the hour, half hour, and quarter hour using standard notation. 




1 


2 






2.3.3 


Reads dates on the calendar. 






1 






2.3.4 


Recites months of the year in order. 


1 


1 








2-3.5 


Reads the Celsius thermometer to five-degree intervals. 






1 






2.3.6 


Estimates and uses standard units of length, capacity, and mass with correct 
symbols — m, cm, L, kg. 




1 


5 






2.3.7 


Identifies appropriate measuring instrtments for a given task. 


2 


3 








2.3.8 


Counts a collection of coins up to 25f£. 






1 







2.3.9 


Gives equivalent value of coins up to 256. 






1 






2.3.10 


Makes purchases up to 256. 






1 








Grade 2 Measurement Strand Total 


3 

13% 


7 

29% 


14 
58% 


0 

0% 


0 
0% 




Grade Three Measurement Objectives 


PO 


EC 


LC 


EF 


F 


3.3.1 


Tells and writes the time to the nearest hour, half hour, quarter hour, and 
five-minute intervals. 




1 


3 






3-3.2 


Orders months of the year. 




1 








3.3-3 


Reads the Celsius thermometer to one degree intervals and uses the symbol(°C) . 






1 






3.3.4 


Counts collections of coins up to $1.00. 






1 






3-3.5 


Mak?s purchases and change up to $1.00. 






1 






3-3.6 


Extends estimation and measurement to include the use of the standard units 
kilometre and decimetre with symbols km and dm. 






2 






3.3-7 


Uses standard measuring instruments (metre stick, litre container, mass 
scales, calendar, Celsius thermometer). 






5 








Grade 3 Measurement Strand Total 


0 
0% 


2 

13% 


13 
87% 


0 
0% 


0 

0% 




Grade Four Measurement Objectives 


P0 


EC 


LC 


EF 


F 


4.3.1 


Reads and writes time to minutes. 




i 


1 






4.3.2 


Reads Celsius thermometer, and determines reasonableness of readings to given 
situations. 






2 






4.3.3 


Extends estimation and measurement to include the use of the standard units 
of millimetre, millilitre, and gram with symbols mm, mL, and g. 






6 







9 

ERIC 
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200 



14. 3. 4 


Uses appropriate standard measuring units for length, capacity, and mass. 






3 






4.3.5 


Uses money (coins and bills) for purchasing and making change. 






2 






4.3.6 


Expresses linear measure to the nearest tenth and hundredth of a metre. 








I 






Grade 4 Measurement Strand Total 


0 

0% 


0 

0% 


14 

93% 


1 

7% 


0 

0% 


— - - 


Grade Five Measurement Objectives 


PO 


EC 


LC 


EF 


F 


5.3.1 


Reads and writes time to seconds. 






1 






5.3-2 


Reads the 24-hour clock. 






1 






5.3-3 


Extends estimations and measurements including tonne and its symbol t. 












5.3.4 


Reads distances according to a scale. 






1 


1 




5.3-5 


Draws 2-dimensional figures to scale using grid paper. 






1 


1 




5.3.6 


Uses appropriate standard measuring units for length, capacity, and mass. 












5.3.7 


Understands the system of metric prefixes including the use of symbols: 
kilo- (k) , hecto- (h) , deca- (da), basic unit, deci- (d), centi- (c), 
and milli- (m) . 




1 


1 






5.3.8 


Expresses linear measures in expanded form. 






! 






5.3-9 


Expresses equivalent linear measures. 








1 




5.3.10 


Finds perimeter of polygons without using formulas. 












5.3.11 


Finds area of polygons without using formulas. 








1 





5.3.12 


Finds volume of rectangular solids without using formulas. 








1 






Grade 5 Measurement Strand Total 


0 

0% 


1 

5% 


13 
68% 


5 
26% 


0 

0% 
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Grade Six Measurement Objectives 


! PO 


EC 


LC 


EF 


F 


6.3.1 


Finds perimeter of polygons with and without formulas. 






1 


1 




6.3.2 


Finds area of triangles and rectangles using formulas. 








2 




6.3.3 


Finds volume of rectangular solids using formulas. 








1 




6.3.4 


Reads and determines distances according to a scale. 






1 


1 




6.3.5 


Draws diagrams according to a scale. 






1 


1 




6.3.6 


Reads the 24-hour clock and writes corresponding time notation. 






1 






6.3.7 


Understands and uses the system of metric prefixes including the use of 
symbols: kilo-, hecto-, deca-. basic unit, deci-, centi-, milli-. 




1 


1 


1 




6.3.8 


Expresses equivalent measures within units of length, capacity, mass, and 
time with symbols. 








1 




6.3.9 


Measures angles. 








1 






Grade 6 Measurement Strand Total 


0 

0% 


1 

n 


5 

33% 


9 

60% 


0 

0% 
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Grade 1 Space Objectives (Geometry and Graphing Strands) 


PO 


EC 


LC 


EF 


F 


1.4.1 


Classifies 3-dimensional objects according to various attributes. 




1 








1.4.2 


Recognizes and names circle, square, triangle, and rectangle. 


1 










1.5.1 


Collects data from the immediate environment to construct graphs using 
pictures or obiects and discusses fchp rpsults. 




1 










Grade 1 Space Total 


1 


2 


0 

\jf) 


0 

fit 


0 

fit 


















Grade 2 Space Objectives (Geometry and Graphing Strands) 


PO 


EC 


LC 


EF 


F 


2.4.1 


Classifies 3-dimensional objects in relation to corners, edges, and faces. 




1 








2.4.2 


Classifies 2-dimensional figures in relation to boundaries, corners, and faces. 




1 








2.4.3 


Develops and continues patterns using 3-dimensional objects and 2-dimensional 
figures. 




1 


1 






2.4.4 


Demonstrates svmmetrv throuch foldinc and cutting. 




i 
i 








2.5.1 


Constructs and interprets pictographs and simple bar graphs using data 

collected from imnipdi ate pnvi rnnmpnt" 

vvllvVVVU XI will Xltmi^vJ X Cl wC CIJ V ll V/IJII1CIJ u . 




1 


1 








Grade 2 Space Total 


0 

0% 


5 
71% 


29i 


0 

\J fit 


0 


















Grade 3 Space Objectives (Geometry and Graphing Strands) 


PO 


EC 


LC 


EF 


F 


3.4.1 


Classifies and identifies 3-dimensional objects and 2-dimensional figures. 




1 








3.4.2 


Constructs simple 3-dimensional objects. 




1 








3.4.3 


Constructs simple 2-dimensional figures. 




1 
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3.4.4 


Identifies symmetric figures and draws lines of symmetry on 2-dimensional 
f icures. 




1 








3.5. 1 


Identifies fne syps 




1 
I 










3.5.2 


Collects data and r»on^t*rnr»t*^ ni ptv^crranh^ and ^imnl p K or crranViQ 




1 
1 


i 
i 


i 
i 




3.5.3 


Interprets pictographs and simple bar graphs. 




1 


1 


1 




3.5.4 


TjOoatPS iY>sit"inn of* an nnipot on a crrid 






i 
i 








Grade 3 SDace Total 


n 

\j 

0% 


7 

58% 


25% 


c 

m 


0 
u 

0% 


















Grade 4 SDace Obiectives (Geometrv and Granhinc Strands^ 








FF 

LA 


r 


4.4.1 


Identifies properties of 3-dimensional objects and 2-dimensional figures. 






2 






4.4.2 


Constructs 3-dimensional objects and 2-dimensional figures. 




2 








4.4.3 


Determines whether or not a 2-dimensional figure is symmetric. Draws axes 




1 








u u u 


ir drjo±auc;o uiiQco/ diiu reiJLcuuo viiipo/ concreue odjgcuo. 




c 








U ^ 1 


uoDotructo picuo&rapuo dnu Dar grdpuo. 




1 


1 


1 




U ^ P 


xlJUcipf cl-o pivj /U^ldpilo dlJU Udi gi apilo. 




1 


1 


1 




4.5.3 


Writes coordinates as ordered pairs. 








1 




4.5.4 


Graphs ordered pairs. 








1 






Grade 4 Space Total 


0 

0% 


7 

47% 


4 
27% 


4 
27% 


U 

0% 



ERIC 
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208 





Grade 5 Space Objectives (Geometry and Graphing Strands) 


PO 


EC 


LC 


EF 


F 


5.4.1 


Constructs and draws 2-dimensional figures. 




1 


1 






5.4.2 


Distinguishes 2-dimensional figures as similar, congruent, or neither. 






1 






5.4.3 


Identifies and draws translations (slides), reflections (flips), and rotations 
(turns) of 2-dimensional figures. 




2 


4 






5.4.4 


Tests congruency of polygons using translations, reflections, and rotations. 






1 






5.4.5 


Names corresponding sides and vertices of congruent polygons. 






1 






5.4.6 


Identifies and names line segments, lines, rays, and 0 les. 




1 








5.5.1 


Constructs pictographs, bar, and line graphs. 




1 


1 


1 




5.5.2 


Interprets and solves problems using pictographs, bar, line, and circle graphs. 




1 


2 


2 




5.5.3 


Reads and writes coordinates from a graph. 








1 




5.5.4 


Graphs ordered pairs. 








1 




5.5.5 


Generates ordered pairs from a given relationship. 








1 






Grade 5 Space Total 


0 

0% 


6 

26% 


11 
48% 


6 

26% 


0 

0% 


















Grade 6 Space Objectives (Geometry and Graphing Strands) 


PO 


EC 


LC 


EF 


F 


6.4.1 


Constructs and draws prisms, pyramids, cones, and cylinders. 




1 


1 






6.4.2 


Draws and identifies radius, diameter, and circumference. 




1 








6.4.3 


Translates, rotates, reflects, and enlarges 2-dimensional figures. 






4 







6.4.4 


Identifies and tests congruency using translations (slides), reflections 
(flips), and rotations (turns). 






1 






6.4.5 


Names corresponding sides, vertices, and angles of congruent polygons. 






1 






6.4.6 


Identifies and names intersecting lines, parallel lines, perpendicular lines, 
and ancles. 




1 










6.5.1 


Constructs pictographs, bar, and line graphs. 






1 


2 




6.5.2 


Interprets and solves problems using pictographs, bar, line, and circle graphs. 






2 


2 




6.5.3 


Locates points in all four quadrants. 








1 




6.5.4 


Generates and graphs ordered pairs from a given relationship (no negative 
numbers) . 








1 






Grade 6 Space Total 


0 

0% 


3 

16% 


10 
53% 


6 

31% 


0 

0% 
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Appendix 6: 
Cognitive Demands Observed in Classrooms 
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Table A6.1: Cognitive Demands of Classrooms Observed, Grade 1 



Class 


Strand 


PO 


EC 


LC 


EF 


F 


Total 


1 


Gt.om/Graph 


C 


9 


0 


5 


0 


14 


1 


Measurement 


0 


11 


1 


2 


0 


14 


2 


Numeration 


0 


34 


0 


1 


0 


35 


3 


Measurement 


0 


18 


0 


11 


0 


29 


4 


Operations 


0 


35 


1 


0 


0 


36 


5 


Numeration 


0 


28 


0 


1 


0 


29 


6 


Measurement 


0 


23 


0 


2 


0 


25 










All 


Numeration 


0 

0$ 


62 
97% 


0 

0% 


2 

3% 


0 

0$ 


64 

100$ 


All 


Operations 


0 

0$ 


35 
97% 


1 

3% 


0 

0$ 


0 

0$ 


36 
100$ 


All 


Measurement 


0 

0$ 


52 
76$ 


1 

h 


15 
22$ 


c 

0$ 


68 
100$ 


All 


Geom/Graph 


0 

0$ 


9 

64$ 


0 

0% 


5 
36$ 


0 

0$ 


14 
100$ 



ERIC 
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Table A6.2: Cognitive Demands of Classrooms Observed, Grade 2 



Class 


Strand 


PO 


EC 


LC 


EF 


F 


Total 


1 


Operations 


0 


17 


0 


0 


0 


17 


1 


Geom/Graph 


0 


11 


0 


2 


0 


13 


2 


Measurement 


0 


0 


24 


0 


0 


24 


2 


Geom/Graph 


0 


3 


0 


35 


0 


38 


3 


Measurement 


0 


0 


23 


5 


0 


28 


4 


Numeration 


0 


5 


7 


0 


0 


12 


4 


Operations 


0 


18 


0 


0 


0 


18 


5 


Numeration 


0 


6 


9 


2 


0 


17 


5 


Operations 


0 


0 


8 


8 


0 


16 


6 


Operations 


0 


11 


10 


5 


0 


26 










All 


Numeration 


0 


11 


16 


2 


0 


29 






0% 


38% 


55% 


7% 


0% 


100% 


All 


Operations 


0 


46 


18 


13 


0 


77 






0% 


60% 


23% 


17% 


0% 


100% 


All 


Measurement 


0 


0 


47 


5 


0 


52 






0% 


0% 


90% 


10% 


0% 


100% 


All 


Geom/Graph 


0 


14 


0 


37 


0 


51 






0% 


27% 


0% 


73% 


0% 


100% 



ERJC 
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Table A6.3: Cognitive Demands of Classrooms Observed, Grade 3 



Class 


Strand 


PO 


EC 


LC 


EF 


F 


Total 


m 

1 


Numeration 


0 


0 


5 


0 


0 


5 


1 


Operations 


0 


27 


5 


0 


0 


32 


2 


Measurement 


0 


0 


30 


10 


0 


40 


3 


Operations 


0 


t| 


42 


2 


0 


li c 
HO 


4 


Geom/Graph 


0 


22 


2 


11 


0 


35 


4 


Operations 


0 


10 


0 


0 


0 


10 


1: 
M 


Numeration 


0 


0 


3 


0 


0 


3 


5 


Operations 


0 


22 


6 


6 


0 


34 










All 


Numeration 


0 

0% 


0 

0% 


8 

100% 


0 

0% 


0 

0% 


8 

100t 

1 \J\Jfi 


All 


Operations 


0 

0% 


63 
51% 


53 
43% 


8 

6% 


0 

0% 


m 

100% 


All 


Measurement 


0 

0% 


0 

0% 


30 
75% 


10 
25% 


0 

0% 


40 
100% 


All 


Geom/Graph 


0 

0% 


22 
63% 


2 

6% 


11 
31% 


0 

0% 


35 
100% 



ERIC 



183 

216 



Table A6.4: Cognitive Demands of Classrooms Observed, Grade 4 



Class 


Strand 

j 


PO 


EC 


LC 


EF 


F 


Total 


1 


Geom/Graph 


0 


20 


1} 


2 


0 


26 


2 


Geom/Graph 


0 


13 


36 


1 


o 


SO 


3 


Numeration 


0 


1 
1 


1Q 


J 


n 


O 


4 


Geom/Graph 


0 


38 


11 


0 


0 


49 


5 


Geom/Graph 


0 


24 


25 


0 


0 




6 


Numeration 


0 


6 


15 


26 


0 


47 


7 


Operations 


0 


11 


0 


20 


0 


31 


8 


Operations 


0 


29 


26 


0 


0 


55 










All 


Numeration 


0 


7 


34 


31 


0 


72 






0% 


10% 


47% 


43% 


0% 


100% 


All 


Operations 


0 


40 


26 


20 


0 


86 






0% 


47% 


30% 


23% 


0% 


100% 


All 


Measurement 






All 


Geom/Graph 


0 


95 


76 


3 


0 


174 






0% 


55% 


44% 


1% 


0% 


100% 



ERIC 
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Table A6.5: Cognitive Demands of Classrooms Observed, Grade 5 



Class 


Stt and 


P0 


EC 


LC 


EF 


F 


Total ! 


1 1 

1 


Operations 


0 


2 


15 


13 


0 


30 


2 


Geom/Graph 


0 


18 


25 


3 


0 


46 


3 


Geom/Graph 


0 


0 


18 


20 


0 


38 


4 


Numeration 


0 


0 


28 


17 


0 


45 


5 


Measurement 


0 


0 


16 


7 


0 


23 


6 


Geom/Graph 


0 


8 


32 


0 


0 


40 


7 


Operations 


0 


0 


0 


46 


0 


46 


8 


Numeration 


0 


0 


5 


36 


0 


41 


9 


Operations 


0 


0 


22 


33 


0 


55 


10 


Geom/Graph 


0 


23 


25 


0 


0 


48 










All 


Numeration 


0 

0% 


0 

0% 


33 
38% 


53 
62% 


0 

0% 


86 

100% 


All 


Operations 


0 

0% 


2 

2% 


37 
28% 


92 
70% 


0 

0% 


131 
100% 


All 


Measurement 


0 

055 


0 

0% 


16 
70% 


7 

30% 


0 

0% 


23 

100% 


All 

i 


Geom/Graph 


0 

0% 


49 
29* 


100 
58% 


23 
13% 


0 

0% 


172 
100% 




Table A6.6: Cognitive Demands of Classrooms Observed, Grade 6 



Class 


j Strana 
i ■ 


PO 


EC 


LC 


EF 


F 


Total 


1 


Numeration 


0 


0 


1 


25 


0 


26 


2 


Geom/Graph 


0 


0 


49 


6 


0 


55 


3 


Numeration 


0 


0 


6 


29 


0 


35 


4 




0 


0 


5 


35 


0 




5 


Numeration 


0 


0 


0 


34 


0 


34 


6 


Operations 


0 


0 


0 


12 


42 


54 










All 


Numeration 


0 


0 


12 


123 


0 


135 






0% 


OX 


9X 


91% 


ox 


100% 


All 


Operations 


0 


0 


0 


12 


42 


54 






ox 


0% 


0% 


22? 


78X 


100X 


All 


Measurement 






All 


Geom/Graph 


0 


0 


49 


6 


0 


55 






0% 


0% 


89% 


11X 


OX 


100% 



ERIC 
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Appendix 7: 

Cognitive Demands of Provincial Achievement Test Items, 

Grades 3 and 6 
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Taoie A7.;: ;:g*:tive Demanca or Items in Aiotrta Grade 3 Acr;avs.iie.-.: res: 
. : 933 J . 



I ten 


:^;-::sve 


1 cui urn 


Faculty 


ItCfl 


Cognitive 


Cam cuium c a 


t 

c ; i 1 1 v 




i.e/e. 


jcjective* 


ip-val ue> 


NO. 


Level 


Oojective* 


-vai u« - 








. ' 00 


iO 


LI 


T *> i 

. • a . ; 


. a » . 


i 

i ~ 


lC 


3.1.1 


. odd 


27 


LC 


3.2.2 


. 89a 


I 

j 


L C 


3.1.1 


. 702 


28 


LC 


3.2.2 


.75* 


4 


EC 


3.1.5 


.392 


29 


EC 


3.2.2 


.896 


5 


lC 


3.1.3 


.713 


30 


LC 


3.2.2 


.454 


0 


c r 
tu 


«; • 1 • L 


• OJ 0 


T 1 


i p 

LL 


TOT 




7 


EC 


3.1.2 


.938 


^ a. 


LC 


3.2.5 


.867 


6 


EC 


3.2. 1 


.716 


33 


EC 


3.2.4 


.534 




EC 


3.1.4 


.780 


34 


EC 


3.2.6 


.767 


1U 


EC 


3.1.5 


.573 


35 


LC 


3.2.5 


.858 


i j 
i 1 


LL 


X 1 s 


7 ft A 


XL 


LL 




nnn 
. 000 


12 


EC 


3.1.5 


.851 


37 


LC 


3.2.5 


.907 


13 


EC 


3.1.5 


.52b 


38 


LC 


3.2.8 


.799 


14 


EC 


3.1.5 


.478 


39 


LC 


3.2. l 


.8b6 


15 


uC 


3.1.7 


.514 


40 


LC 


3.2. 1 


.467 




! C 


J « 1 . 0 


. Qui 


& t 


i r 




• / w*t 


1 7 


LC 


3.1.7 


.437 


42 


LC 


3.2. 1 


.623 


13 


EC 


3.4. 1 


.904 


43 


LC 


3.2. 1 


. 683 


19 


EC 


3.4.1 


.565 


44 


LC 


3.3. 1 


.833 


20 


EC 


3.4.2 


,479 


45 


EC 


3.3.2 


.935 


21 


EF 


3.4.2 


.443 


46 


LC 


3.3.4 


.883 


22 


LC 


3.3.2 


.333 


47 


LC 


3.3.5 


.805 


23 


EC 


3.5.2 


.803 


48 


LC 


3 1 3 1 w 


.793 


24 


UC 


3.5.4 


.664 


49 


LC 


3.3.6 


.746 


25 


LC 


3.5.4 


.617 


50 


LC 


3.3.7 


.934 




• Numbering 


scheae correspond* to 


that 


of Appendix 


5, which lists 


each 



abjective in full. 
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7 aoit A"M; loqmtive Demands of Items in Aioe r ta Graae i A:nieveatnt Test 









Fici 1 ity 


item 


Cognitive 


Curriculum : a 


. ity 


NO. 


Lev 5 i 


Oo;ective* 


vp-vaiue) 


NO. 


L«vei 


Oo:ecuve« : 


- ^iue) 


1 


lC 


6.1.1 


.670 


26 


EF 


6.2.3 


. 536 


/ 


EC 


6.1.1 


. 525 


27 


EF 


5.3.1 


. 398 


T 


EF 


6.1.2 


.537 


28 


EF 


6.3.2 


, 497 


4 


LC 


6.1.3 


.530 


29 


EF 


5.5.1 


. **37 


5 


EF 


6.1.4 


.633 


30 


EF 


6.3.3 


. 604 


6 


EF 


6.1.4 


.638 


31 


EF 


U ▼ T 

0 . J . v 


.611 


7 


lC 


6.1.5 


.586 


32 


EF 


6.3.5 


. 651 


8 


EF 


6.1.6 


. 353 


33 


LC 


6.3.6 


. 572 


9 


EF 


6.1.7 


. 409 


34 


EF 


6.3.8 


.619 


10 


EF 


6.1.8 


.588 


35 


EF 


6.3.8 


. 731 


11 


EF 


6.1.8 


.587 


36 


LC 


6.4. 1 


.631 


12 


lC 


6.2. 1 


. 865 


37 


lC 


L A T 

6.4.3 


. 548 


13 


lC 


5.2. 1 


. 792 


38 


LC 


t A T 

6.4.3 


• 615 


14 


LC 


6.2.1 


.673 


39 


EC 


L A L 

6.4.6 


■ I A 

• 514 


15 


EF 


6.2.3 


.825 


40 


LC 


6.4.3 


.610 


16 


EF 


5.2.4 


.790 


4i 


LC 


6.5.2 


.978 


k * 


EF 


5.2.3 


.668 


42 


EF 


6.5.2 


.261 


13 


EF 


6.2.4 


.598 


43 


EF 


6.5.2 


.555 


19 


tC 


6.2.4 


.700 


44 


e c 
cr 


L ^ T 
6.0.0 




20 


F 


6.2.5 


.434 


45 


EF 


6.5.3 


.671 


21 


F 


6.2.5 


.741 










22 


EF 


6,2.6 


.632 










23 


EF 


5.2.5 


.596 










24 


EF 


6.2.8 


.677 










25 


F 


6.2.8 


.677 












* Nuafctrtt*9 


tchtaa corresponds to 


that 


of Appandix 


5, which lists 


•*ch 



objactivc **>f»ll. 
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Appendix 8 

ACLIC Paper-and-pencil Test Item Characteristics and 
Source References 
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APPENDIX 8 

ACLIC Paper-and-pencil Test Characteristics 
and Source References 
Number 3/4 



ACLIC 


SOURCE 


MATHEMATICAL 


ACLIC 


BRYTES 


COG- 


ALBERTA 


ITEM # 




TOPIC 


P value 




NITIVE 


EDUCATION 






(%) 




LEVEL 


P value 








Gr 3 


Gr 4 






(%) 


1 


5 3 


Betweenness 


63 


72 






70 


2 


5 10 


Expanded Notation 


57 


69 






57 


3 


5 15 


Decimal 


62 


52 






54 


4 


5 14 


Expanded Notation 


37 


46 






48 


5 


5 17 


Fraction 


41 


38 




LC 


44 


6 


2.AM1.19 


Seriation 


80 


82 


45* 




7 


2.AM1.20 


Bridging - 100' s 


66 


72 


45* 


LC 




8 


2.AM1.21 


Sequence 


83 


81 


48* 


LC 




9 


2.AM1.22 


Bridging - 10' s 


50 


67 


42* 


LC 




10 


2,AM2,2 


Place Value 


71 


81 


35* 


EC 




11 


2,AM2,7 


Comparing Numbers 


90 


84 


45* 


LC 




12 


2,AM2,21 


Comparing -2 Attributes 


77 


89 


45* 


LC 




13 


2,AM2,26 


Comparing Numbers 


52 


65 


45* 


LC 




14 


2,AM2,27 


Multiplying by 10 


57 


60 


50* 


EF 




15 


2.AM4I.28 


P.V. Multiple Step 


24 


32 


55* 


EF 




16 


2,AM6I,1 


Fractions 


34 


35 


45* 


LC 




17 


2,AM6I,2 


Fractions 


60 


64 


45* 


LC 




18 


2.AM7I.7 


Fractions 


77 


87 


45* 


LC 




19 


3 


Subtracting Across 0 


48 


48 


47* 


LC 




20 


4 


Subtracting Across 0 


20 


82 


55* 


EF 




21 


1.UI.3 


Rounding 


19 


59 


45.0 


LC 




22 


1,UII,1 


Fractions 


38 


51 


45.5 


LC 




23 


1.UII.3 


Estimating - x 


13 


1 9 
I L 


47.5 


LC 




24 


1.UII.11 


Problem Solving Fractions 


47 


52 


47.9 


LC 




25 


3 


Betweenness Fractions 


06 


07 


48* 


LC 




26 


3 


Bridging -100' s 


20 


39 


45* 


LC 




1. 


ACER MPS Number Test 












2. 


ACER AM 1,2. 


41, 61, 71 












3. 


SESM - Brown, Hart & Kucheman 












4. 


Davis & McKnight 












5. 


Alberta Education Grade 3 Achievement Test 










* 


ACLIC Calculated 
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APPENDIX 8 

ACLIC Paper-and pencil Test Item Characteristics 
and Source References 
Number 5/6 



AfLir 


SOURCL' 


MATHEMATICAL 


ACLIC 


RRYTFS 

Dr\ I 1 CO 


LUu"" 


ML DlK 1 M 


ITEM # 




CONTEXT 


P value 




NTTTVF 

111 1 1 V L 


Fni ir/lTTHN 
lUULM 1 I Uli 








(%) 




LLVlL 


r va I ue 








br b 


r» r 

Gr o 










3 1 


Plarp Vp 1 up — mpt i ma 1 q 


b/ 


79 

It 






0/ 


9 


3 ? 

J, c 


r I ale V a 1 Uc UcL 1 Ilia 1 b 


C 1 

bl 








DO 


O 


j) j 


FynxnrlpH Mntaf inn 
LApctMucu iiu tat I u N 


bo 


o4 






5A 
b4 


4 


3 4 


Rniinrli nn 


"37 
0/ 


**y 






5? 
00 


5 


1 7 


f\cLi r cbcii lau i ui i — r r aL i i ui I b 


5c 


A Q 

Hy 






5Q 

Dy 


u 


i in 


ni i 1 1 ny iiUiiicra i b 


4 I 


£9 
OC 






5Q 

Dy 


7 


3 11 


RpflHinn Numprfll^ 


51 


bU 






5Q 


« 

u 


3 1? 


h*t" m r t l nn /lrrncc fi 

JUULI OLl IIIU HL i U b b u 


ob 


on 
oU 






0/ 


9 


1 UI 3 


Pound i nn 

r\ yj u 1 1 u i 1 1 y 


00 


79 
1 C 


0 


1 f 

LL 




10 


1 I J T T 1 


Fr art "i nn Q-PpnrAQpnt a t i nn 

1 1 QL L 1 UI 1 j l\Cpi CjCIIIQI 1 UM 


£7 
0 / 


1A 
/4 




1 c 

LL 




11 


1 If T T 3 


Fct* imat l nn— Mill 1 1 nl i ration 
Lot i ilia t i ii y riu i t i p i i Lai iuii 


5n 

DU 


A7 
0/ 


47 

*T / • O 


1 C 
LL 




12 


1 LIT 5 


Prnh 1 pm-^n lv/inn Fr^rt innQ 
r i \ju i on ju i v iiiy ii at i I ui I b 


oy 


/l "3 


47 Q 


1 C 
LL 




13 


2,AM7,7 


Frart i nn ^ 


l o 


cy 




FF 

L 1 




14 


1,UI,14 


Prnnnrt i rui^ 


40 


"3A 
JO 


SO 1 


FF 

LI 




15 


3 8 


Pprrpn t 


1 7 

I / 


1 4 






75 

OD 


16 


1 AM6.3 


Fnuivalpnt Fractions 


AR 
40 


4<i 


55* 


FF 

L_ 1 




17 


4 


Bridaina - 100 ! s 


66 


73 


45* 


L \j 




18 


4 


R&t\tJ&&nn&$ L ^ FrartinnQ 

UClnCCMMCj j 1 l QWl IUII O 


21 


26 




i r 

LL 




19 


2 AM4 28 


P.V.-Mul tiDle SteD 

i • » • I iu 1 U 1 yJ 1 ^ *J l*CL/ 


43 


57 


55* 


FF 

L 1 




20 


1,UI,22 


Proportion-Fractions 


21 


19 


53.5 


EF 




21 


1 ,U 1 1 ,6 


Division-Decimal s 


CO 


"37 
51 


50.1 


EF 




22 


1 ,UI 1 ,2 


Fraction-Proportion 


55 


<:o 


52.9 


EF 




23 


1 ,U 1 1 , 9 


Compensatory Manipulation 


35 


CO 

by 


49.0 


LC 




?4 


1 NT T T 5 


fnmnAnQfltnrv Maninul atinn 
uuiiipdibaLur jr nan i uu i at I un 


23 


43 




FF 

LI 




?5 


1 IIT ?3 


Mpp l ma 1 c + — 
ucl i ma ib) > 


13 


22 


54 n 

* U 


FF 

LI 




26 


1 ,UI ,25 


Proportions 


10 


23 


54 5 


FF 

LI 




27 


1.UIII.14 


Proportion - 


26 


36 


57.2 


EF 




28 


1.UII.16 


Fractions-Number Line 


12 


17 


54.5 


EF 




29 


1 , U 1 , 24 


P.V. Multiply by 10 


12 


24 


54.2 


EF 




30 


1 ,UI , 16 


Fraction of a Set 


11 


10 


50.6 


EF 




1. 


ACER MPS Numb 


er Test 












2. 


ACER AM 














3. 


Alberta Education grade 6 Achievement Test 










4. 


SESM, Brown, 


Hart & Kucheman 












* 


ACLIC Calculated 
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APPENDIX 8 

ACLIC Paper-and-penci 1 Test Item Characteristics 
and Source References 
Operations 3/4 



An ir 




nippjnn mm 


ACLIC 






m i oer ta 


ITCM a 




HQ ifpttvf 
Ud JLL live 


P value 




NI I 1 Vt 


tUULAI 1UN 








i%) 




LtvtL 


r value 
















(A) 








br j 


br h 








1 


1 


Commutative + 


52 


75 


25.9 


P0 




2 


1 


Commutative x 


62 


84 


29.6 


P0 




3 


1 


Identity-Division 


71 


68 


35.0 


EC 




4 


1 


Identity Property of 1 


81 


97 


27.1 


P0 




5 


1 


Associative x 


50 


59 


37.8 


EC 




6 


1 


Identities-Subtraction 


51 


59 


36.9 


EC 




7 


1 


Additive Identity 


88 


81 


40.3 


LC 




8 


1 


Associative + 


49 


57 


41.4 


LC 




9 


1 


Addition of 1 


85 


82 


38.7 


EC 




10 


1 


Multiplication 0 


59 


89 


42.3 


LC 




11 


1 


Commutative + 


61 


75 


34.3 


EC 




12 


1 


Commutative x 


66 


79 


34.4 


EC 




13 


1 


Premature Closure 


80 


83 


37.2 


EC 




14 


1 


Identity Property of 1 


63 


88 


39.0 


EC 




15 




Associative x 


67 


78 


36.4 


EC 




16 


] 


- not Commutative 


63 


75 


40.2 


LC 




17 




Additive Identity 


78 


86 


40.3 


LC 




18 




Associative + 


61 


76 


41.7 


LC 




19 




Add 1 


77 


81 


41.4 


LC 




20 




Multiplication -0 


52 


81 


48.1 


LC 




21 


2 33 


Commutative + 


57 


71 






48 


22 


2 34 


Identity x 


39 


81 






44 


23 


2 35 


Missing Multiplier 


39 


91 






80 


24 


2 36 


Missing Addend 


60 


87 






62 


25 


2 37 


Missino, Subtrahend 


79 


89 
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ACLIC Paper-and-pencil Test Item Characteristics 
and Source References 
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ACLIC 


SOURCE 


MATHEMATICAL 


ACLIC 


8RYTES | COG- 


ALBERTA 


ITEM # 




CONTEXT 


P value 




NITIVE 


EDUCATION 












LEVEL 


P value 








Gr 5 


Gr 6 






\ To) 


i 

1 


i 

I 


rnmmu t at i vi t v + 

isvJiiiiiiviuviui v i u y 


83 


88 


PS 9 


P0 




2 

Cm 


j 


Commutati vi tv x 


85 


93 


29.6 


P0 




3 




* not Commutative 


69 


90 


35.0 


EC 




4 




Identity property of 1 


95 


97 


27.0 


P0 




5 


<| 


Associ ati vi ty- x 


69 


88 


37.8 


EC 




6 


<] 


- not Commutati ve 


61 


83 


36.9 


EC 




7 


<] 


Additive Identity - 0 


87 


96 


40 3 


LC 




8 




Associative + 


57 


83 


41 4 


LC 




Q 




Addi ti on of 1 


77 


83 


3ft 7 

JO ♦ / 


P0 

r \j 




m 




x Prnnprtv nf 0 


81 


85 


4? 3 


i r 




1 1 




Inverses + - 


89 


n. "7 

97 


44 5 


LC 




12 




Inverses + x 


77 


90 


48 0 


LC 




13 




romDpnsatorv Manipulations 


43 


63 


46.9 


LC 




14 




Compensatory Manipulations 


37 


39 


5? 4 


FF 




15 




Pomnensatorv ManiDulations 


28 


28 


SO 7 


EF 

km 1 




1fi 




rnmnpnsatnrv ManiDulations 


17 


24 


50.4 


EF 




17 




Distribution Property 


44 


79 


56.7 


EF 




18 




not Associative 


23 


15 


S3 ? 


FF 




19 




Subtraction - not Associative 


13 


12 




EF 

km I 




?0 




x Distribution over * 


13 


09 


62.7 


F 




21 




Commutative + 


69 


88 


34.3 


EC 




22 




Commutative x 


70 


92 


34.4 


EC 




23 




* not Commutative 


"7 O 

78 


97 


37.2 


EC 




24 


] 


Identity Property of 1 


86 


95 


39.0 


EC 




25 




x Associative 


67 


93 


36.4 


EC 




26 




- not Commutative 


70 


01 


40.2 


LC 




27 




+ Identity -0 


89 


95 


40.3 


LC 




28 




+ Associativity 


57 


89 


41.7 


LC 




29 




Addition of 1 


76 


77 


41.4 


LC 




30 




X 


61 


71 


48.1 


LC 




31 


2 19 


Problem Solving 


53 


75 






70 


32 


2 22 


Division Checking 


43 


68 






63 


33 


2 26 


Problem Solving 


33 


58 
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ACLIC Paper-and-penci 1 Test Item Characteristics 
and Source References 
Measurement Test 3/4 



ACLIC 


SOURCE 


MATHEMATICAL 


ACLIC 


BRYTE5 


COG- 


ITEM # 




CONTEXT 


P values 




iittt wr 

N III VE 








(*) 




LtVtL 








131 O 


(Xr & 

U 1 ** 






1 


2,11,1 


Mass-Conservation 


o * 


91 


35* 


EC 


2 


2 


Mass-Weighing 




Q7 


30* 


EC 


3 


2,12, 13 


Capacity-Conservation 


00 




42.1 


LC 


4 


2,10,3 


Area-Iteration 




O / 


39.4 


EC 


5 


2,11, 10 


Mass 




75 

/ o 


33* 


EC 


6 


2,8,6 


Length-Conservation 


ov 


?4 

Ot 


43.5 


LC 


7 




Length-Metric 




UJ 


37.6 


EC 


8 


2,9,8 


Length-Estimation 


oo 


O J 


35.6 


EC 


9 


2,9,9 


Scale Drawing 


57 


DC 


45.2 


LC 


10 


2,8, 10 


Length-Conservation 


OH 


7fl 


42.2 


LC 


11 


2,13, 7 


Time-Duration 


^4 


oo 


40* 


LC 


12 


2 J1, 12 


Mass-Transitivity 


O 7 




45* 


LC 


13 


2,13,13 


Seriati on-Time 


J c 


81 

O 1 


40* 


LC 


14 


2,11, 20 


Mass-Weighing 


?4 


24 


45* 


LC 


15 


2,11,23 


Mass-Conservation 


16 


27 


37* 


EC 


16 


2,11, 16 


Multiple Attributes 


43 


47 


50* 


EF 


17 


2,13,22 


Time-Duration 


26 


45 


40* 


LC 


18 


2,10,5 


Area-Ratio 


46 


57 


38.3 


EC 


19 


2,9, 13 


Length-Measurement 


52 


67 


39.8 


EC 


20 


1.UII.30 


Time-Clock 


20 


17 


60.6 


F 


21 


2,10,9 


Area-Conservation 


09 


11 


52.6 


EF 


22 


1.UI.7 


Area-Iteraticn 


24 


44 


48.7 


LC 


23 


2,10,15 


Area- 


16 


23 


49.8 


LC 


24 


2,12,2 


Capacity-Conservation 


68 


80 


38.3 


EC 


25 


2,12,3 


Quantity-Conservation 


63 


80 


33.1 


EC 


26 


2,12,6 


Capacity-Conservation 


62 


69 


37.7 


EC 


27 


2,12,12 


Capacity-Conservation 


47 


53 


33.1 


EC 


28 


1.UII.25 


Volume-Iteration 


12 


18 


56.0 


EF 



ALBERTA 
EDUCATION 
P value 

(%) 



1. ACER MPS Measurement 

2. ACER AM, 8, 9, 10, 11, 12, 13 

* ACLIC Calculated 
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ACLIC Paper-and-pencil Test Item Characteristics 
and Source References 
Measurement 5/6 



ACLiL 


cni inrc 
bUUKlt 


n IDD t r 1 II KM 

luKKIluLUM 




ACLIC 


DQVTCC 

bKY I Eb 


C06- 


ALBERTA 


ITEM ff 




no l cn t \/c 




P values 




NITIVE 


EDUCATION 










it) 




i run 

LEVEL 


P value 








Gr 


5 


Gr 6 






(%) 


1 


1.UI, 2 


Metric Unit Size 


79 






43.9 


LC 




2 


1.UII, 3 


Scale Drawing 


28 




97 
CI 


51.0 


EF 




3 


1,UI, 11 


Perimeter 


54 






51.5 


EF 




4 


1.UI, 7 


Area-Iteration 


56 




DO 


48.7 


LC 




5 


2,10, 5 


Area-Conservation 


72 




OO 


38.3 


EC 




6 


2,10, 10 


Predicting Relationship 


78 




7Q 
/O 


43.9 


LC 




7 


2,10, 11 


Predicting Relationship 


31 




77 


50.2 


EF 




8 


1.UII, 16 


Ratio-Iteration 


09 




1/1 


53.7 


EF 




9 


1.UII, 25 


Volume-Iteration 


14 




OQ 
CO 


56.0 


EF 




10 


1,UII,23 


Area-Space Perception 


32 




CO 


55.3 


EF 




11 


1.UII, 13 


Area-Comparison 


22 




Id 


53.7 


EF 




12 


2,11, 12 


Mass-Transitivity 


56 




OO 


45* 


LC 




13 


2,11, 16 


Multiple Attributes 


57 




JU 


50* 


EF 




14 


1,UI, 30 


Using Scales 


14 




OC 
CD 


57.5 


EF 




15 


1.UI.4 


Scale Drawings 


58 




10 
1 C 


45.2 


LC 




16 


1,UI, 12 


Graphs- Interpretation 


57 




70 

/y 


47.8 


LC 




17 


1,UI, 13 


Graphs- Interpretation 


35 




AO 
^c 


SO. 8 


EF 




18 


2,12, 13 


Capacity-Conservation 


45 




DO 


42.1 


LC 




19 


2,12, 22 


Volume by Parts 


35 




75 

jj 


45.8 


LC 




20 


2,12, 23 


Volume by Parts 


35 




7C 
OO 


49.9 


LC 




21 


2,12,26 


Volume, Iteration 


38 




cc 

00 


43.8 


LC 




22 


1.UI, 10 


Scale Drawings 


42 




00 


50.2 


EF 




23 


1,011,2 


Angle-Estimation 


40 




73 


49.2 


LC 




24 


1,UI, 17 


Speed-Proportional ity 


55 




66 


56.0 


EF 




25 


1,UI, 18 


Speed-Proportional ity 


42 




49 


55.2 


EF 




26 


1.UI.29 


Multiple Attributes 


19 




37 


56.8 


EF 




27 


1,UI,22 


Perimeter 


24 




to 


53.5 


EF 




0 0 
CO 


1 ,UI1 , 18 


Area-Iteration 


00 

cc 






04 • U 


tr 




29 


2,13,22 


Time-Duration 


59 




81 


40* 


LC 




30 


2,12,7 


Vol ume-Transi ti vi ty 


44 




71 


40.0 


LC 




31 


3 44 


Graphing 


29 




34 






59 


32 


3 45 


Speed-Graphs 


31 




51 






67 


Jo 


3 30 


Volume-Iteration 


&8 




65 






oU 


34 


3 29 


Area- 


24 




33 






44 


35 


3 32 


Scale 


37 




62 
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ACER MPS 
















2. 


ACER AM 10, 11, 12, 13 














3. 


Alberta Education Grade 6 Achievement Test 












* 


ACLIC Calculated 
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ACLIC Paper-and-penci 1 Test Item Characteristics 
and Source References 
Space 3/4 



ALL1L 


cntmrr 


MAIHtMAI HAL 


ACLIC 


DK I 1 Lo 


LUo- 


A 1 DCDTA 
ALbtK 1 A 


T TFM A 

1 1 CM ff 




LUN 1 LA 1 


P value 




N 1 1 1 V t 


rnur at thm 








it) 






r Va I ue 








Gr 3 


Gr 4 






(%) 


1 


1,UI,2 


Spatial Orientation 


58 


83 


41.8 


LC 




2 


1.UI.3 


Ordering 


62 


64 


42.5 


LC 




3 


1,UI,4 


Space Orientation 


50 


78 


44.0 


LC 




4 


1.UI.5 


Shape Iteration 


17 


34 


44.1 


LC 




5 


6 


R-L Orientation 


47 


53 


44.7 


LC 




6 


7 


Graphing Ordered Pair 


58 


68 


44.9 


LC 




7 


9 


Properties-Shapes 


60 


60 


45.9 


LC 




8 


15 


Ref lection-Detai 1 


58 


68 


47.6 


LC 




9 


17 


Spatial Orientation 


15 


23 


48.5 


LC 




10 


19 


Form Perception 


45 


38 


49.1 


LC 




11 


22 


Form Perception 


23 


32 


49.0 


LC 




12 


26 


Multiple Steps 


20 


29 


49.8 


LC 




13 


UII, 2 


Volume-Iteration 


33 


49 


44.8 


LC 




14 


3 


Rotation 


33 


54 


45.9 


LC 




15 


6 


Rotation 


12 


09 


46.5 


LC 




16 


7 


Properties of Shape 


49 


47 


48.7 


LC 




17 


10 


Seriation 


5d 


57 


46.1 


LC 




18 


11 


Transformations 


40 


78 


50.2 


EF 




19 


12 


Conservation-Length 


26 


34 


50.3 


EF 




20 


24 


3-0 Space Perception 


17 


27 


53.2 


EF 




21 


31 


Space Perception 


02 


01 


57.3 


EF 




22 


UIII,2 


Rotation 


20 


33 


48.4 


LC 




23 


3 


Volume Iteration 


24 


32 


48.5 


LC 




24 


6 


Comparison-Area 


29 


40 


50.1 


EF 




25 


24 


Symmetry 


26 


24 


59.9 


EF 




26 


2, 20 


3-0 space Perception 


43 


54 






48 


27 


21 


Volume-Iteration 


44 


56 






44 


28 


23 


Graphing- Interpretation 


76 


77 






80 


29 


25 


Coordinates-Ordered Pairs 


25 


31 






62 


30 


24 


Coordinates-Ordered Pairs 


37 


28 
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ACLIC Paper-and-penci 1 Test Item Characteristics 
and Source References 
Space 5/6 



ACLIC 


SOURCE 


MATUCMATT P Al 

MAIHLMAI HAL 


ACLIC 


on uTr c 

BRYTEb 


LOG- 


A 1 O CD T A 

ALdlK 1 A 


iTEM w 




CONTEXT 


P value 




MTTTl/r 

NITI VE 


LUULAi IUN 








(%) 




LEVEL 


P value 








GR 5 


Gr 6 






(%) 



1 


1.UI, 1 


Spatial Orientation 3-D 


63 


80 


39.9 


EC 




2 


2 


Spatial Orientation 3-D 


68 


79 


41.8 


LC 




3 


3 


Order 


56 


77 


42.5 


LC 




4 


4 


Spatial Orientation 3-D 


63 


82 


44.0 


LC 




5 


5 


Shape-Iteration 


36 


49 


44.1 


LC 




6 


6 


Spatial-Orientation 


64 


72 


44.6 


LC 




7 


7 


Graphing-Ordered Pairs 


70 


85 


44.9 


LC 




8 


8 


Transformations 


23 


45 


45.0 


LC 




9 


9 


Properties of 2-D Shapes 


60 


79 


45.7 


LC 




10 


10 


Ref lection-Detai 1 


68 


79 


46.2 


LC 




11 


11 


Space Perception 3-D 


29 


44 


46.4 


LC 




12 


12 


Space Orientation 2-D 


29 


44 


46.5 


LC 




13 


13 


Rotation-Orientation 


77 


79 


46.9 


LC 




14 


14 


Inverses - 2 Attributes 


40 


50 


47.0 


LC 




15 


15 


Ref lection-Detai 1 


61 


83 


47.6 


LC 




16 


16 


Symmetry-Inverses 


31 


45 


48.4 


LC 




17 


1,111,17 


Spatial Orientation 


28 


43 


48.5 


LC 




18 


18 


Spatial Orientation 


42 


63 


48.6 


LC 




19 


19 


Form Perception 


42 


44 


49.1 


LC 




20 


1,UII,10 


Order- 


68 


77 


46.1 


LC 




21 


1,UI, 21 


Spatial Orientation 


31 


36 


49.3 


LC 




22 


1,UI, 22 


Form Perception 


30 


45 


49.0 


LC 




23 


1,UII,31 


Space Perception 


04 


07 


51.8 


EF 




24 


12 


Conservation -Length 


36 


53 


50.3 


EF 




25 


1,UI, 26 


Multiple Steps 


26 


32 


49.8 


LC 




26 


27 


Space Perception 2-D 


29 


50 


49.8 


LC 




27 


28 


Reflections 


28 


45 


50.0 


EF 




0 D 
CO 


29 


i terati on j-u 


28 


26 


DU • c 


FP 

LI 




29 


30 


Spatial Orientation 


29 


28 


51.2 


EF 




30 


31 


Interrelations 


50 


64 


51.8 


EF 




31 


1,UI, 32 


Coordinates-Order Pairs 


23 


47 


51.7 


EF 




32 


2 44 


Graphing-Ordered Pairs 


13 


22 






59 


33 


2 36 


3-D Space Perception 


42 


62 






63 


34 


2 37 


Transformations 


23 


43 






55 


35 


2 40 


Translation 


34 


41 






61 


36 


1,UI, 24 


Compari son-Angles 


28 


53 


49.4 


LC 




1. 


ACER MPS 














2. 


Alberta Education grade 6 Achievement Test 
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Raw Scores Corresponding to Cognitive Levels of Response 
ACLIC Paper-and-Pencil Tests 



ACLIC Test 


Items* 


PV 


1 

EC 


LC 


EF 


F 


Number 3/4 


20 


0-6 


7-10 


11-16 


17-20 


- 


Number 5/6 


21 


0-5 


6 


7-12 


13-18 


19-21 


Operations 3/4 


20 


0-4 


5-12 


13-18 


19-20 




Operations 5/6 


30 


0-2 


3-10 


11-20 


21-27 


28-30 


Measurement 3/4 


28 


0-10 


11-16 


17-22 


23-27 


28 


Measurement 5/6 


30 


0-8 


9-11 


12-19 


20-26 


27-30 


Space 3/4 


25 


0-6 


7-10 


11-16 


17-22 


23-25 


Space 5/6 


31 


0-8 


9-13 


14-21 


22-28 


29-31 


* Number of items on cognitive scale; does not include 
Alberta Achievement Test items 
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Data Sources for Cognitive Levels of Response 



Table A9.1: Data Sources for Cognitive Levels a* Response, Nuaerttion 



Grade i Interviews 


PO 


EC 


LC 


EF 


F 


Total 


BLOCKS 1 


13 


31 


16 


0 


0 


60 


HPiiMC i f rt r r a « n n n A m n r m i \ 


1 A 


1 / 


1 7 


.\ 
V 


A 

U 


*; o 

JO 


(Correspondence 2) 


16 


25 


17 


0 


0 


58 


i ur o i n a 1 1 on / 


7 


0 I 


20 


A 
U 


0 


58 


r luwcko itquivaience) 


ID 


I 7 


30 


0 


0 


62 


Inf i^ifi aw Tn f a 1 ■ 

IniBr VI lf» i ot «i s 




i 7 i 

1 L 1 


1 1 A 


A 
V 


A 

u 






22X 


4U 


37X 


07. 


OX 


100X 


Grade 2 Interviews 


PO 


EC 


LC 


EF 


F 


Total 


BLOCKS 7 


y 


Q 
0 


*i A 


1 


A 
V 


3Y 




5 


1 T 
1 0 


a i 


A 

v 


A 
V 


37 


TOFFEE 


IS 


29 

m 7 


1 0 


T 

0 


A 
V 


3" 


Interview Total* 


5^ 
* v 


50 

J V 


1 01 


a 


A 
V 


1 7fl 
I/O 




13X 


282 


37X 


2X 


OX 


100X 


Gradt 3 Tnfsrx/isuc 

mi BUI v 111 III Y A IN 1 


pn 

r u 


C v* 


1 P 


cc 

Cr 


c 

r 


T n f * 1 

i o t ai 


BLOCKS 3 


0 


27 


28 


5 


0 


60 


TOFFEE 


17 


17 


17 


9 


0 


60 


interview lowcis 


1 / 


11 

44 


43 


1 4 


A 

0 


120 




ux 


37X 


37X 


12X 


ox 


100X 


(?■ a J ■ C Q * **. a* fla bL O am. aa •» • 1 

braoe o raper « pencil Test 


7 1 


K A 

SO 


34 


0 


A 

0 


4 4 at 

1 IS 




10X 


43X 


47X 


ox 


ox 


100X 


Sradt 4 Paoar 1 Pencil Test 


1 
• 


26 


53 


1 7 


o 


94 

7 ^ 




n 


28X 


S9X 


13X 


ox 


100X 


Sridt S Ptpir 1 Ptncil Ttst 


IS 


36 


36 


3 


0 


92 




16X 


42X 


39X 


3X 


ox 


100X 


Sradt 6 Ptptr 1 Ptncil Ttst 


13 


IS 


SI 


11 


0 


90 




UX 


17X 


S7X 


12X 


ox 


100X 
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Taoie A9 • 2 : Oata Sources for Cognitive Levels of Response, Operations 



Grade 




i*tS r * 1 9 H5 


PQ 


EC 


LC 


EF 


F 


T c ". a i 






5 l j - r S : 


13 


31 


lo 


0 


0 


60 






COOKIES -vlnvariance) 


23 


[ t 


25 


0 


0 


9') 






(Scaring) 


16 


19 


25 


0 




c; 






DIVIDED BOXES 


27 


30 


T 

J 


0 


0 


60 






FLOWERS (Multiplication) 


15 


12 


35 


0 


0 


62 






PARKING 


il 


49 


0 


V 


0 


60 






Intsrvi ew Total s 


1 A K 
103 


f K 7 
ISO 


\ A A 

104 


0 


V 


362 . 








297. 


42X 


297. 


07. 


07. 


1007. 


Grade 


2 


Intervi ews 


PO 


EC 


LC 


EF 


F 


Total 






BLOCKS 2 


0 


8 


50 


1 


0 


59 






COOKIES ( Invan anct) 


14 


12 


33 


0 


0 


C ft 

59 






(Sharing! 


I 


17 


41 


0 


0 


59 






DIVIDED BOXES 


11 


17 


31 


0 


0 


59 






FLOWERS (Multiplication) 


11 


11 


37 


0 


0 


59 






Interview Totals 


37 


65 


192 


1 


0 


295 
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3 


36 


43 


12 
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ox 
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20 
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EC 


LC 


EF 


F 
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33 


13 


13 


0 


0 
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(Ta^K Set B) 


33 


17 


4 


0 


0 
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43 


7 


10 


0 


0 
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36 


13 


7 


0 


o 
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25 


24 


9 


0 
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30 
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0 


0 
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16 


13 


I 
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30 


14 


12 


3 
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PO 


EC 


LC 


EF 
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Total 


BEADS 


8 


12 


10 


0 


0 
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0 
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60 
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0 


57 
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0 
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14 


39 


3 


3 


0 


59 


(Task 3) 


10 


44 


2 


3 


0 


59 
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0 
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19 


27 


9 


5 


0 


60 
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12 


31 


6 


11 


0 


60 
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21 


25 


14 


0 
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45 


0 
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60 
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26 
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